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NONLINEAR  TRANSFORMATIONS  OF  IKE  NORMAL  RANDOM  PROCESS 

(Power  spectra) 


1.  General  Solution,  Obtained  by  Correlation  Method. 

Ihe  normal  randan  process  occupies  a  central  place  in  the  majority  of  the  practi 
cal  applications  of  the  theory  being  discussed  here.  Therefore  a  systematic  expo¬ 
sition  is  in  order,  of  the  transformations  undergone  by  a  normal  random  process  in 
its  passage  through  radio-equipment  components  of  various  types. 

It  has  been  noted  above,  that  the  problem  of  the  passage  of  a  normal  random 
process  through  linear  systems  is  a  comparatively  simple  one,  since  the  process  re¬ 
tains  its  normal  distribution  at  the  output;  only  'the  correlation  function  of  the 
process,  and  the  power  spectrum  corresponding  to  it,  are  subject  to  change.  All 
formulas  necessary  to  the  computations  are  contained  in  Section  2,  Ch.VI.  Therefore, 
the  principal  interest  is  presented  by  the  problem  of  the  nonlinear  transformation 
of  a  normal  random  process. 

In  the  present  chapter  me  indicated  problem  will  be  restricted  to  a  study  only 
of  the  correlation  function  and  power  spectrum  of  a  process  at  the  output  of  a  non¬ 
linear  system.  For  this  we  shall  employ  the  general  methods  indicated  in  Section  6, 

Ch.  VI* 

Let,  at  the  input  of  a  nonlinear  system,  there  act  a  random  process  constituting 
a  sum  of  the  determined  process  (e.g.,  signal)  S(t)  and  a  stationary  normal  random 
process  with  a  zero  mean  value  (e.g,,  fluctuation  noises).  In  accordance  with  (5.9 6), 
the  two-dimensional  distribution  function  of  this  process  has  the  form  of 

I  "  -  jiCfii!  ±  (x,-a,)  (ir-a. I 

1 - »  wn-m - ~ 

(7.1) 


AJ,  t,X)  = 


2*9*  y\ 
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A,  . 


trJ:  V.  if.r  . ,  '' 


where  a^  =  S(t),  a2  =  S(t  +t),  while  R  =  R(r)  and  is  the  correlation  coefficient 
and  dispersion  of  the  stationary  portion  of  the  randon  process. 

Substituting  (?.l)  into  (6,5),  we  obtain  the  expression  for  the  correlation 
function  of  the  random  process  at  the  output  of  a  nonlinear  system  with  a  character¬ 
istic  of  y  =  f(x),  at  the  input  of  which  there  acts  a  determined  signal  in  sum  with 
a  stationary  normal  random  process 


j  J  W/WX 

— oo  —go 

—  <T»  ~~  fig  ^  2ft  (ft  —  <it>  (x,  —  a .)  +  (x,  -  q>)? 

Xe 


(7.2) 


Effecting  in  (7.2)  the  substitution  of  for  o’  and  of  xg  for  o"x2,  and  adopt¬ 


ing  the  designations 


=  £iL)  „  S(t+r) 
•  *1 - 


we  reduce  the  expression  for  the  correlation  function  to  the  form  of 


~  oo  oo 

B  (-.,!)  =  — jL_  J  j  /(«,)/(3x2)  X 

—30  —00 

Xe  *<!-«•» 


(7.3) 


For  computation  of  the  double  integral  in  (7.3)  we  shall  employ  the  first  of 
the  methods  indicated  in  Section  6,  Ch,  VI, 

In  the  case  under  discussion,  the  one-dimensional  distribution  functions  cor¬ 
responding  to  w2 (<rx^ ,  <rx2,  r  )  are  equal  to 

_  (*,  -  «,r 

*,,(jf,)==F&e  2  • 

,  «.)»  .  (7.4) 

*,,{x?,==pke  2  * 


with  the  variables  Xj  and  x2  covering  the  range  of  from  —  oo  to  +  co.  If  the  functions 
(7.4)  are  adopted  as  weighting  functions,  then,  as  is  known  (cf.  the  book  of  V.  Is, 
Gonchareov  cited  on  p.  241),  the  a;;&regates  of  orthogonal  polynomials  corresponding 
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to  them  are  the  Hermite  polynomials  Hn(xj  -«^)  and  Hn(x2  -  Appendix  VII). 

An  expansion  of  (6.57)  for  a  two-dimensional  normal  distribution  function  has  the 
following  form: 


1 


_  (ii  - «,)« -  m  (jti  - «,)  ix,  - 4  ix,  -  «,>« 
.  t  (l 


<*|—  «,)'■)•  (<!  —  §,)» 
- 


fjTrWi-'W.to— >r. 


(7.5) 


We  substitute  the  series  thus  obtained  under  the  integral  sign  in  expression 


(7.3) 


to  00  00 

«W)  =  S  J  j  f  («.)  f  (ox2)  £-£//„  (x,  -  a,)  Hn  (x2  -  a2)X 

—SO  —SB  ■  <1-0 

(*i  —  «i)«  -Hx,  —  «,)« 

X  e  2  dx[dx2. 


Changing  the  order  of  summation  and  integration,  and  noting  that  the  variables 
of  integration  are  thereby  separated,  we  find 


in  R*[  l  ? 

<1-0  \  —oo 

(i  r  _  <*»-—>•  \ 

y~.  j  /  (aXj)  Hn  {x2  ~  a2)  e  2  d*2J . 


dxAX 


(7.6) 


Vfe  introduce  the  designation 


(jt  - 


e»~Yft  j  f(ax)ffJx-a)e~  2  rfx. 


(7.7) 


Then  from  (7.6)  we  obtain  the  desired  expression  for  the  correlation  function  of 
a  random  process  at  the  output  of  a  nonlinear  system 


m 

B  (x,f)  =  CUC2<I  > 


(7.8) 


••0 


where  C]_nand  c2n  are  obtained  from  cn,  if  in  (7.7)  in  place  of*  are  respectively 


*  Expansion  (7*5)  way  be  obtained  without  difficulty  if,  with  the  employment  of  in¬ 
tegral  representation  of  a  two-dimensional  normal  distribution  function  in  terms  of 
a  two-dimensional  characteristic  function  and,  with  the  expansion  into  a  series  of 
the  exponential  multiplier  containing  a  pioduct  of  the  variables  in  the  integrand 
expression,  the  integrals  are  expressed  in  terms  of  Hermite  polynomials. 
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assumed  ot^  arid  ee  ,  Since  in  the  general  case  correlation  function  (7.8)  depends 
on  time,  therefore,  before  calculating  the  power  spectrum,  it  is  necessary  to  average 
this  correlation  function  over  time 

_  r 

\  (7.9) 

~r 

Since  in  the  series  (7*8)  only  the  coefficients  C^n  and  C£n  are  functions  of 

time. 


i  f. 

'  ) 


C 


(7.10) 


*-o 


where 


r 

T 


r  j  cincudt 


(7.11) 


Subjecting  (7.10)  to  a  Fourier  transformation,  we- obtain  an  explicit  expression 
for  the  power  spectrum  of  a  normal  random  process  vdiich  has  passed  through  a  non¬ 
linear  system 


F  M=<  cos  •**=«  j  Jj?  (,)cos.sit. 

•  n-0  J 


(7.12) 


2.  Case  of  Stationary  end  Narrow-band  Input  Process. 

Let  the  determined  portion  of  a  normal  process  be  lacking,  Then*^  *  *  0,  and 
from  (7.8)  we  obtain  the  expression  for  the  correlation  function  of  the  process  at 
the  output  of  a  nonlinear  system  upon  the  input  of  which  there  acts  a  stationary 
normal  random  process  (e.g.,  noise  in  the  absence  of  a  signal) 


where 


m  ^ 

Cm~V^  J  f  (9X)Hm  W«  *  dx. 


(7.13) 


(7.1*0 
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-fr 

4 


The  first  tern  in  the  series  (7.13)  corresponds  to  the  direct  component  (dis¬ 
crete  portion  of  the  spectrum),  and  the  sum  of  the  remaining  terns,  to  the  continuous 
portion  of  the  power  spectrum  of  a  random  process  at  the  output  of  a  linear  system. 

Let  the  power  spectrum  of  a  stationary  normal  process  be  a  narrow-band  one,  i.e., 
let  it  be  concentrated  in  a  relatively  narrow  frequency  band  about  the  high  frequency 
6>o  ,  at  which  spectral  density  is  at  its  maximum  and  with  respect  to  which  the 
spectrum  nay  be  considered  symmetrical.  An  example  of  such  a  process  may  be  found 
in  noise  at  the  output  of  a  linear  system,  the  band  of  which  is  much  smaller  than  its 
resonance  frequency.  In  accordance  with  (5*82)  the  correlation  coefficient  may  be 
represented  in  the  form  of 

*W  =  *o(*)COSa>#T,  ) 

where  Rq (tt)  is  the  correlation  coefficient  of  the  envelope  of  the  random  process  at 
hand.  Substituting  (7.15)  into  (?.13)»  we  find 


»-0 


(7.16) 


We  replace  the  powers  of  the  cosines  in  (7.16)  by  the  sum  of  the  cosines  of  the 
multiple  arcs  according  to  the  veil- known  formulas 

r«-i 


C0S**XS= 


*  £  [s 2 t! * ) 1 cos 21 [n  -  *>  ■ * + ft)]  • 

c<***-‘  x=~J]  (*r  *)  cos  (2  n  —  2*  —  i)  x. 


(7.17) 


(7.18) 


Then  expression  (7.16)  of  the  correlation  function  of  the  process  at  the  output 
of  a  nonlinear  system  will  take  the  form  of 


:  B  ^  S  C**  (2n)\  22'1  **  W  + 
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JLtvy-A. 


(2n  — ^  '(*)«»  (2/1  —  2k—  I)w0t-f 


*-i  A-0 


0*  H— 1 


-!  g  /2n\ 

5)  J]  (2/»)!  <*  (T)  cos .2  («  —  A)  0>0T. 


n-1 t-o 


(7.19) 


Adopting  the  designation  r  =  n  -  k  and  changing  the  order  of  summation  in  the 
double  sums,  we  obtain 


Designating 


<e  (2n\ 

UJ 


'2n  (2ft)!  a2" 


+ 


bw=5] 

A— 0 

f)  (2ft— -If!  *T‘  (T)  COS«0t  + 


+  g|E^feb  /?o2"",Wjcos(2r-l)o,0t  + 


r-2  (_*-/■ 

do  r  00 


f»l  _ft-r  j 


A 


>w=ScL 


*-0 


|2«\ 

1  "  '  D*" 

(2«)!2*"  8  ' 


•  *  /2«-l\ 

b»-w=2)  1 r;  - *?-  w. 


I)!  2V/I 

•  »  /  2ft  \ 

s»w=SwiSi'ftt 


(7.20) 

(7.21) 

(7.22) 

(7.23) 


we  rewrite  (7.20)  in  the  form  of 

&  W  ~  A0(t)-|-  (t)  cos  ui#t  -f- 


+2N-  I W  cos  -.0«V  +  jta  (t)  cos  2rw0t. 


(7.24) 


The  power  spectrum  is,  in  accordance  with  Khinchin’s  theorem,  equal  to  a  Fourier 
transformation  of  B(r).  If  the  Fourier  transformation  of  each  of  the  items  in  (7.24) 

is  designated  by  F  («),  i.e., 

r  m 

F, (•) — 4  f  Bf  (t)  cos  ru0 1  cos  t»t dt,  (7.25) 


F-TS-9811/V 


259 


then  we  obtain  the  following  expression  for  the  power  spectrum  of  the  random  process 


at  the  output  of  a  nonlinear  system 


F(‘)=F, 


(7-26) 


A  graphical  representation  of  this  spectrum  is  shown  in  Figure  48  (the  dotted  line 
indicates  the  spectrum  of  the  normal,  stationary  process  acting  on  the  input  of  the 
system). 


r 


i  aw 


!  fj(u) 


Fig.  48.  Power  spectrum  of  narrow-band  random  process  after 

nonlinear  transformation. 

The  first  term  in  (7.26)  represents  the  low-frequency  portion  of  the  power 
spectrum  (the  so-called  video  spectrum)  of  the  random  process  at  the  output  of  a 
nonlinear  system.  The  second  term  corresponds  to  the  portion  of  the  power  spectrum 

of  the  output  process  lying  about  frequency  co  ,  where  is  also  concentrated  the 

o 

spectrum  of  the  input  process.  The  remaining  terms  in  (7.26)  correspond  to  the  high- 
frequency  portions  of  the  power  spectrum  of  the  process  at  the  outrut  of  a  nonlinear 
system,  which  lie  about  the  odd  and  even  harmonics  of  frequency  . 

The  video  spectrum  FQ(«)  is  of  greatest  interest  in  the  study  of  demodulation 
processes  in  radio  receivers,  whereas  the  spectrum  band  F^ («)  is  important  to  the 
study  of  the  modulation  process  in  radio  transmitters. 

From  (7»2l)  -  (7.23)  it  can  be  seen  that  for  the  computation  of  a  power  spectrum 
it  is  necessaiy  to  obtain  inverse  Fourier  transformations  of  the  powers  of  the  cor- 

Ic 

relation  coefficients  R  (r).  The  higher  is  k,  the  less  are  the  spectrum  densities / 
corresponding  to  R0  (r),  but  the  wider  is  the  frequency  band  occupied  by  the  spectrum. 
For  large  instances  of  k,  computation  of  the  power- spectrum  component  which  cor- 
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responds  to  (7)  i5  complex.  However  function  (r)  diminishes  so  rapidly,  that 
an  appropriate  approximation  may  be  employed.  Thus,  for  instance,  if  the  spectrum 


of  a  random  process  is  uniform  in  band  A  t  then  according  to  (6.18) 


•in¬ 


ti 

* 


Since 


there  is  permissible  the  approximation 


and  the  power  spectrum  (inverse  Fourier  transformation)  corresponding  to  this  ap¬ 


proximation  is  equal  to 


3.  linear  Detector. 


As  the  first  example  illustrating  the  method  set  forth  above,  let  us  consider 
the  manner  in  which  the  correlation  function  and  spectrum  of  a  normal  random  process 
are  transformed  in  its  passage  through  a  linear  detector*,  whose  characteristic  has  , 

k 


*  Here  and  in  the  future,  in  accordance  with  Section  1  Ch* VI detection  is  regarded 
only  as  a  nonlinear  and  noninertial  process.  The  subsequent  action  of  the  filtering 
element  must  be  treated  separately. 


;i 
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the  form  of 


>=fW={ 


x  x>0, 
0  x<0 


(7.27) 


(the  constant  multiplier  for  x  i3  assumed  equal  to  unity,  which  is  not  essential 
since  it  serves  the  purpose  of  scale  and  may  always  be  taken  into  account  in  the 
final  results). 

The  coefficients  cn  in  series  (7.13)  are  in  the  case  at  hand  obtained  from  the 


integral 


When  n  =  0  and  n  =  1  we  obtain  directly 


•  *• 
•  I*  “T 


l=Fs  ’  dx~  T  • 


When  2,  we  obtain  by  integrating  by  parts 


(7.28) 


(7.29) 


.  em=±=^l.[x££±.dx=i T Of  »’  rfx: 

*  V2*  J  d>*  V2k  J  dM”~l 

_(-»)■*'«  d'-*  (  -  y)  7 

yu  4*- * '  '  • 

• 

or 

Substituting  (7.28)  -  (7.30)  into  (7.13).  we  find 

»W=S-['+l*(')+2^(0)*^ll 

■  a-1  •* 

Bearing  in  mind  (cf.  Appendix  VII),  that 

*»<0)=(-I)*(2*-I)l!.  //„_,(0)=0, 


(7.30) 
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(  )  ‘ 


we  obtain  the  following  expiession  for  the  correlation  function  of  a  stationary- 
normal  random  process  which  has  passed  through  a  linear  detector; 


«<')=£-[' +i*u +  ^ + £  . 

tTt  * 


(7.3D 


Series  (7.31)  may  be  summed  up,  and  then  the  expression  of  the  correlation  function 
is  represented  in  the  final  form; 

+  arc s>n /?<*)] /?(t) -f-  (?02) 

9j'  expanding  (7.32)  into  a  series,  it  is  not  difficult  to  verify  that  it  coincides 
with  (3*71).  As  can  be  seen  from  (7*32).  the  difference  between  the  correlation 
functions  of  the  processes  at  the  output  and  input  of  a  linear  detector  is  an  ever, 
function  of  the  correlation  coefficient  of  the  input  process  £  correspondingly  series 
(7*31)  contains,  besides  the  first  power  of  the  correlation  coefficient,  only  even 
powers  of  Rfr)]  *. 

If  the  power  spectrum  of  a  stationary  normal  process  is  concentrated  in  a 
relatively  narrow  frequency  band  around  the  high  frequency  in  such  a  manner,  that 
for  the  correlation  coefficient  R  (r)  of  this  process  formula  (7.15)  is  valid,  then, 
in  accordance  with  (7.2h)  and  (7.30), 


(  ) 


or 


B  (*)  =  B0  (*)  +  ~  *0  W  cos  <v  +  Bv  (t)  cos  2ru*0t, 

f-1 


(2nj!  2*1  ^  ^}‘ 


(7.33) 


*  Ihe  fact  that  the  correlation  function  of  a  process  at  the  input  of  a  linear  de¬ 
tector  does  not  contain  any  other  odd  powers  of  R  except  the  first,  is  not  unexpected.^ 
In  fact,  (7.27)  may  be  represented  in  the  form  of  the  sum  of  two  functions 

f(x)  *  J  x  +  f 1  (x), 

where  fj  (x)  *  f(x)  -  \  x  will  be  an  even  function  of  the  argument  x. 
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The  first  term  B0(t*)  in  expression  (7*33)  corresponds  to  the  direct  component  and  to 
the  low-frequency  portion  of  the  continuous  power  spectrum  of  a  random  process  at 
the  output  of  a  linear  detector.  Series  (7.34),  which  represents  function  Bq(t), 
may  be  summed  up,  and  its  sum  may  then  be  expressed  in  terms  of  full  elliptical 
integrals  of  the  first  K(Rq)  and  second  E(R0)  kinds  (cf. ,  e.g.,  R.  Yanke  and  F.  Bade. 
Tables  of  functions.  Gostekhiidat,  1948) 

fl«<,)=5-l2E(/?0)-(!-^)K(/?0)j.  •  (7.36) 

After  a  Fourier  transformation  of  (7.34)  and  (7.36),  we  obtain  the  low-frequency 
portion  of  the  power  spectrum  of  a  process  at  the  output  of  a  linear  detector.  The 
first  term  in  expansion  (7.34)  yields  the  direct  component,  and  the  sum  of  the 
Fourier  transformations  of  the  even  powers  of  the  correlation  coefficient  yields  the 
continuous  spectrum. 


Fig.  50*  Low-frequency  spectrum  of  random  process  which  has 

passed  through  a  linear  detector. 

Figure  $0  shows  the  continuous  low-frequency  spectrum  of  a  process  at  the  output 
of  a  linear  detector,  for  the  case  when  the  power  spectrum  of  a  normal  stationary 
process  at  the  input  is  uniform  in  a  band  whose  width  is  equal  to  A  .  The  ex¬ 
ponential  series  for  RQ  in  (7.34)  converges  so  rapidly,  that  in  practice  for  the 

computation  of  the  spectrum  it  is  possible  to  restrict  one's  self  to  only  the  term 
2 

R0.  Then  for  the  case  under  consideration  the  low-frequency  portion  of  the  continu¬ 
ous  spectrum  will  have  the  form  of  a  right  triangle  with  a  base  of  &  .  This  ap¬ 
proximate  spectrum  is  designated  in  Figure  SO  by  the  dotted  line  (compare  Fig.  49). 
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’****kr r%*  <•■*<'’  f  **<■  '  i-_ 


Comparison  with  the  exact  spectrum  indicates  an  entirely  satisfactory  approximation. 
The  relationship  of  the  areas  of  the  continuous  exact  and  approximate  spectra  (i.e., 
of  power,  concentrated  in  the  low-frequency  range)  is  equal  to  (2“  t)  TT 

==!’1, 

and  the  spectrum  density,  when  W  =  0,  (i.e.,  the  correlation  time)  is  6/S  greater  for 
the  exact  than  for  the  approximate  spectrum.  In  distinction  from  the  approximate 
one,  the  exact  spectrum  contains  frequencies  higher  than  A  ,  but  their  intensity  is 
negligibly  small. 

The  second  tern  R0(r)  coso^r  in  expression  (7.33)  corresponds  to  the 
undistorted  (with  accuracy  to  the  constant  multiplier)  reproduction,  at  the  output 
of  a  linear  detector,  of  the  spectrum  cf  a  stationary  normal  random  process. 

The  succeeding  terms  B,.  Or)  cos  2r  a>0f  in  expression  (7.33)  correspond  to  the 
high-frequency  portions  of  the  power  spectrum  of  a  process  at  the  output  of  a  linear 

detector,  wnicn  lie  about  the  even  harmonics  of  frequency  u  .  The  correlation  time 

0 

and,  consequently,  the  spectrum  densities  when  Ci  =  2ro>Q  diminish  sharply  with  a 
rise  in  the  harmonic  number  2r,  since  in  the  expression  [cf.  (?.35))  the  least 

exponent  of  R  (r)  is  equal  to  2r.  The  areas  of  the  continuous  spectra  (i.e.,  the 
powers)  situated  about  the  harmonics  of  0JQ,  diminish  in  inverse  proportion  to  the 
magnitude  V  \?.?  +  3/2)* 


4,  Approximation  of  Kon-llnear  Characteristics  by  Exponential  Series 

If  the  function  f(x),  which  provides  an  analytic  concept  of  the  characteristic 
of  a  nonlinear  system,  is  continuous  together  with  its  derivatives,  then  it  can  be 


resolved  into  Kaclaurin  series 


/  (*)=/(<>) +*/'(0) +4  r  (0)+ . . . + £  r  (0) + . . . 


(7.37) 


For  this  reason  the  nonlinear  characteristic  f(x)  is  frequently  (for  instance,  in 
cases  of  full-wave  detection)  approximated  by  an  exponential  series  of  the  type  of 


/(*)=a0+Oi*+ a, **+... 


(7.33) 
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the  coefficients  of  which  must  be  equal  to  the  corresponding  coefficients  of  series 
(7.37). 

With  such  an  approximation  it  is  not  difficult  in  the  general  case  to  determine 
the  coefficients  c^n  and  C£n  in  series  (7.8) .  These  coefficients  are  obtained  from 
integral  (7.7) »  which  in  the  case  under  consideration  has  the  form  of* 

ri  «,•’  r  -lira.* 

j  *■".<*-*>«  ’  (7.39) 

»»0  —CO 


The  integrals  in  (7*39)  are  easily  computed,  if  the  integrand  function  be  represented 
as  a  derivative  with  respect  to  the  parameter*  ,  Then 

•o  (*-«)> 


I*’*"  ’  d*h 

i«0  \  —a*  / 

u0  \  —0*  / 


y»0  A«>0 

where  m^^is  a  distribution  moment  of  the  (p  -  k)th  order  of  a  normal  distribution 
with  unitary  dispersion  and  a  zero  mean.  Differentiating  with  respect  toi 
<*•  and  employing  (3.80),  we  find 


r-9k-n 


oo  eo 


r-Ok-it 


or,  after  changing  k  =  n  +  s  in  the  summation  index 


‘EE 

r-0  i-o 


a  (n+s+2r\  (*  +  *)!(2r  - 1)!!  a* 

*+*+2r  \  n-f-*  /  ||  *  ♦ 


(7.40) 


*  In  practice,  a  summation  with  respect  to  will  contain  only  a  small  number  of 
terms.  This  will  indicate  that  the  coefficients  a $  ,  starting  with  a  certain  >>  , 
turn  to  zero.  For  the  sake  of  generality  we  retain  the  summation  for  all  positive 
instances  of  >>  , 
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It  is  .necessary  to  bear  in  mind,  that  when  r  =  0  it  is  conventional  that  (2r  -  1 ) 1 1 
=  1.  It  is  further  necessary  to  average  in  time  the  product  of  c^*  c 2  ,  upon  which 
depend  fe^t)  and  tt^t).  Designating  by 


T . 


(7.41 ) 


we  find  from  (7.10),  (7.11)  and  (7.40)  the  averaged  correlation  function  of  a  process 


at  the  output  of  a  nonlinear  system 


•-0  r,«  0  r,-0  0  j,  -0 

X  #2« +*!+»•+*  ('»+'.)  +  *j  +  2fj^n  +  sH-  2r,^  ^ 

X  (/>  +  f,)<  (n  +  5»)!  (2r«  -  1>!l  <2f«  -  l>!i  A  /.*  o«  M 

it!  *•!  n!  v)  *  W* 


(7.42) 


Tb  the  discrete  portion  of  the  power  spectrum  correspond  (in  the  sense  of  a 
Fourier  transformation)  the  terms  where  n  =  0,  and  to  the  continuous  portion,  the 
terms  where  n>0. 

If  the  determined  portion  of  a  normal  process  is  lacking,  then  in  (7.42)  all 
the  terms  disappear,  with  the  exception  of  those  obtained  when  =  0.  Then 

from  (7.42)  we  find  the  following  expression  for  the  correlation  function  of  a 
stationary,  normal  random  process  which  has  passed  through  a  system,  the  nonlinear 
characteristic  of  which  is  approximated  by  the  exponential  series  (7.33) 

«<<>«=£*»  jjf; 

r,-0r,-0 

X  ("  Vr')(n  Vrt)  (2r»  -  »>!t  (2 r,  -  I)!!  n\, 

and  since  the  summation  along  r^  and  r^  is  separable,  therefore 


«w= 


■-0  IrS)  J  . 


(7.43) 


let  us  write  out  several  of  the  first  terms  of  summation  (7.43),  neglecting  the  ap¬ 
proximating  coefficients  a^  higher  than  n  =  5 
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\\*} 
•  4 


I 

*..-<*)=  Km  7  J  S(t)S*(t-\-x)dt, 


(7.50) 


* 

*,.(t)=Iimf  J S*(/)S*(/+t)rf/. 


(7.5D 


The  magnitude  A0  represents  the  direct  component  of  the  process,  and  the  magni- 

tude  its  mean  power.  The  magnitudes  Bs(r),  Bsx(ir)  and  Bg  ga(r)  are  respectively 

2 

the  autocorrelation  functions  of  process  S(t),  of  its  square  S  (t)  and  the  mutual 
correlation  function  of  S(t)  and  S  (t). 

With  the  employment  of  the  designations  introduced  above,  the  expression  of  the 
averaged  correlation  function  of  the  random  process  obtained  as  a  result  of  the 
quadratic  transformation  of  a  normal  process,  may  be  represented  in  the  form  [cf. 
(7.42)]  of 

£•  (t) = (a„  -f  c29*)  (a0  4.  a,3*  -f  2a ,  At -f 2  a2Wt)  -f 

+ al  Mi-  (*)  +  a\  B„  (t)  + 

Bt (t)] R (x) -f- 2a* a4/?2 (x).  (7*52) 


,  ♦ 

fiach  item  in  (7.52)  has  a  clear  physical  interpre cation.  The  first  line  yields  ,* 
the  power  of  the  direct  component,  the  second  line  corresponds  to  the  discrete  portion  : 
of  the  spectrum,  and  the  last  line  to  the  continuous  portion  of  the  spectrum. 

The  direct  component  contains  elements  both  of  the  determined  and  of  the  random 

i: 

parts  of  the  process  at  the  input,  the  share  of  the  determined  part  of  the  process  in 
the  direct  component  being  equal  to  2a0(a^As  +  a2W3),  and  the  share  of  the  random 
part  coming  to  (aQ  +  a2  or  )  .  In  addition,  the  direct  component  also  contains  the 

i 

mean  power  of  the  beat  between  the  components  of  the  determined  and  the  random  parts 

,3 

of  a  normal  process.  This  latter  is  equal  to  2a2<JJ(ajAs  +  a2Wg).  | 

The  discrete  spectrum  after  quadratic  transformation  reproduces  the  discrete  input  § 

a  ‘k 

spectrum  £the  term  a^  Ba(tO J  ,  and  also  contains  combination  harmonics  of  the  mutual  i 
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beats  of  the  components  of  the  determined  part  of  a  normal  process  C  the  succeeding 
terms  in  the  second  line  of  formula  (7.52) J  . 


The  continuous  spectrum  after  quadratic  transformation  reproduces  the  input 
continuous  spectrum  [the  term  a*  o^RCfjJ  ,  and  also  contains  combination  harmonics 
of  the  mutual  beats  of  the  components  of  the  random  part  [the  term  2a*  o'*  *  «j 
and  of  the  components  of  the  determined  and  the  random  parts  [the  remaining  terms  in 
the  last  line  of  formula  (7.52)  ]  . 


quare-law  Detection  of  an  Amplitude-modulated  Signal  in  the  Presence 


of  Noise. 


Let  us  assume,  that  the  determined  part  of  a  normal  process  constitutes  an 


amplitude-modulated  signal 


S  (/)  =  «(/)  cos  O)0/, 


(7.53) 


the  highest  harmonic  in  the  spectrum  of  the  envelope  u(t)  being  much  smaller  than 


the  carrier  frequency  <0  , 


Let  us  assume  that  the  stationary  random  part  of  the  normal  process  represents 


noise,  the  power  spectrum  of  which  is  concentrated  in  a  relatively  narrow  frequency 


band  about  the  same  high  frequency 6)  .  ftien  the  correlation  coefficient  P.  fT!)  of 


the  noise  may  be  represented  in  the  fora  of  (7.15). 


Let  us  employ  the  results  of  the  preceding  section  for  solving  the  problem  cf 


the  detection  of  an  amplitude-modulated  signal  in  the  presence  of  noise.  It  is  ob¬ 


vious  that,  in  order  to  restore  the  low-frequency  envelope  u(t)  from  the  radio  signal, 


the  detector  must  contain,  in  addition  to  a  nonlinear  element,  a  filtering  element 


which  separates  out  the  low-frequency  components  and  suppresses  the  high-frequency 


ones. 


Let  us  first  examine  the  nonlinear  transformation  of  the  signal  with  the  noise, 


assuming  for  the  sake  of  a  simple  illustration  of  the  general  results,  that  as  the 


sv: 


4^ 

nonlinear  characteristic  of  the  detector  there  serves  the  parabola  y  =  a  x  .  (The 


coefficient  ag  may  be  assumed  equal  to  unity,  since  it  serves  the  purpose  of  scale 
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and  may  always  be  taken  into  account  in  the  final  results). 
From  (7.52)  when  aQ  =  a^  =  0  and  a2  =  1,  we  find 

B*  (t)  »  *  +  2*Wt  +  Bt,  (t)  +  4  o2fl,  (t)  R  (t) + 2SR>  (t). 


(7.5'0 


We  now  determine  the  magnitudes  Ws,  Bs  and  E$2  for  an  amplitude-modulated  signal. 
Substituting  (7.53)  into  (7.48),  (7.4?)  and  (7.51 ).  we  obtain  respectively 


Wjes\im  jr  jj U2  (0  COS2  ujdt  =ss 

r  *"* 

;  r 

=sjHm~  j  a2  (/)<//  -f  |lim  y  j  a2(*)cos2u>0M; 


(7.55) 


Z 

Bt(t)  =  Hra^-  j  a  (/)  «(<  4-*)  cos  w,/  cos  «»0  (/  -\-t)dt  = 


CQSUfit 
!  2 


z 

lim  -L  f  a(/)a(*4~t)*tf  4- 
f-* o»  J  J 


4-~Iim --  j  *  (0  #  (*  4* T)  cos  2w0  {t  4" dt\ 

r 

•  r 

B*  (t)=lim  f  j  2  (0  «*  (t  4- *)  cos5  V  cos2  u>0  (t  4 - 1)  d/  = 

“i 

r 

F 

i-  fa*  (0  a*  (*  4- 1 *)  l 1  +  cos  2V + cos  2wo  (*+*)  4- 
4  r-**T  v 

“»  r 

r 

+co*2»,;cos2«0(<4-t)ld/=ljinif  j  u*(t)u*(t->ri)dt  + 


(7.56) 


Z 

4- 1  lim  -y  |  a*  (/)  a*  (t  4-  *)  (cos  2^  4-  cos  2»#  (<4",)1^4‘ 


(7.57) 


■  f  t*'  j'l  * 

P  ■ 
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+ J  «*(/)«*(/ -M) cos 4»0^4-j)  dt. 


T 

r 


(7.57) 

(cor.t’d) 


It  can  be  shown  that,  with  the  assumption  made  above  concerning  the  spectrum  of 
the  signal  envelope,  a  whole  series. of  limits  in  the  cited  expressions  turns  to  zero. 


For  this  use  should  be  made  of  the  fact,  that 

r. 

F 

Jim  J-  f  cos®  fcos«„(f-f x)cf/: 
r-»» 1  J 


r 

i 

r 

F 


=yliin  ^  J  cos  [(».  —  ®„)  <  -f <vl  dt  -f 


r 

"i 

T 

r 


+  yKmf-  J  cos[K+®.)/+vl^  = 


-I 


-j-  cos  ®JfTnhen®(l = mg, 


0  wbenq^tt.. 

Then  in  (7.55)  the  second  limit  turns  to  zero  and,  consequently, 


T 

2 


where  is  the  mean  power  of  the  modulating  signal  u(t). 

In  (7.56)  the  second  limit  also  turns  to  zero  and,  consequently 


T 

r 


B,W=C-£f^I|rn  f-  J  u(t)u(t+x)dt=:±Bm(x) cos»0x, 


(7.58) 


(7.59) 


(7.60) 


where  E^r)  is  the  autocorrelation  function  of  the  modulating  signal,  with  ^  (0) 

=  W,. 


F-7S-98tl/V 


272 


In  (5*57)  the  second  and  fourth  limits  turn  to  zero  and,  consequently, 

r 

B,,W=x(1  +  ‘5fcos2uso,)^f-  J  t)d*=  .  ( 


(7.61) 


-4(>+i 


cos  2m0T  j  Bui{t), 


where  Bul(tr)  Is  the  autocorrelation  function  of  the  square  of  the  modulating  signal. 
Substituting  (7.59)  -  (7.6l)  into  (7»5*0.  taking  (7.15)  Into  account,  we  find 


B'  (t)  =  a4+  ^Bu  (0)  + 1  But  (*)  +  *BU  ft  R0  (t)  + 

* 

■\  W  +  [{  fi..  W + •>«.  (<)  R.  (')  +  <N$  (t)  J  cos  2u)0t, 


(7.62) 


where  R^  (x)  is  the  correlation  coefficient  of  the  envelope  of  the  noise  at  the  inputij 

"S 

of  the  square-law  detector.  ■:? 


In  the  absence  of  a  signal  it  follows  from  (?.62)  that 
BW=«4[1+^W+  Rl  ft  cos  2u»0t], 


(7.63) 


r  ,  is 

In  distinction  from  a  linear  detector  [cf.  (7.33)],  for  which  the  output  cor-  % 

,) 

relation  function  of  noise  is  expressed  as  an  infinite  series  in  terms  of  the  ex-  l 

v, 

'yJ 

ponents  of  the  input  correlation  coefficient  R(r),  the  correlation  function  of  noise  '.] 
at  the  output  of  a  square-law  detector  contain;:  no  power  of  R(r)  higher  than  the  'l 
second. 

Employing  the  expressions  obtained  for  the  correlation  function  and  performing  V 

a  Fourier  transformation,  it  is  possible  to  determine  the  corresponding  power  -i 

A 

spectrum.  ■  i. 

We  shall  illustrate  the  sequence  of  the  computation  of  the  power  spectrum  of  a  .] 
random  process  at  the  output  of  a  square-law  detector,  by  an  example  in  which  the  ; 
modulating  signal  is  harmonic,  with  a  frequency  ofH  ,  i.e.,  -i 


*(0=«o(14-wcosfi/). 


(7.64) 


Let  us,  in  addition,  assume  that  the  power  spectrum  of  noise  at  the  input  of  thef 
detector  is  uniform  in  the  band  of  A  and  is  symmetrical  with  respect  to  the  high  1 
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frequency  W0  (  A  <<  <*>0  ,  A>  2.C1  ).  Then  in  accordance  with  (6.18)  the  correlating 
coefficient  of  the  process  at  the  input  of  the  detector  is  equal  to 


*  (*) = (t)  COS  «#t = cos  «#t. 

T 


(7.65) 


To  determine  the  correlation  function  of  the  process  at  the  output  of  a  square- 
law  detector  we  shall  employ  formula  (?.62).  We  shall  first  compute  the  magnitudes 
Bu  and  B^. 

Substituting  (7.64)  into  .(7.60)  and  (?.6t),  and  also  taking  into  account  (7.58), 
we  find 


2 

S  (t)=lim  ±  f  ul(l+m  cos  O/)  [1  +  m  cos  Q  (/-ft)]  dt= 
r-ot*  J 

“  T 

=«*(t+fcMat ), 
B.(0)=«;(i+f). 


2 

f  uUl  -\-m cos Q/)* [  1  +  m cos fi (/+*))*<// : 
r-*o»f  .1, 

(l  +  m*  +  £ +2m*cos  flt+  £cos  2flt) . 


(7.66) 


(7.67) 


(7.68) 


(  > 


Substituting  (7.66)  -  (7.68)  into  (7.62)  and  effecting  a  regrouping  of  the  terms. 


we  obtain 


B*  W = T  [2o*  +  “5  ( 1  +  t)J  +  T  m* cos  fl ' + 

4*  ~gf* cos  "f*  cos  2u»0t  -f  cos  St  cos  2»#t  -f- 

+  ^cos2Qtcos2»0t4.«Jo>/?0(t)^I-|-!jcosSt^+  (7.6?) 

+  <**£#  W + u\  W  t  cos  j  cos  2t»oT + 

.  (t)  cos  2u»0t, 

with  Rd(f)  being  determined  from  (7*65). 

To  compute  the  power  spectrum  of  a  process  at  the  output  of  a  square-law  de¬ 
tector  it  is  now  necessary,  in  accordance  with  Khinchin*s  formula  (5*44),  to  effect 
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an  inverse  Fourier  transformation  on  From  the  expression  of  the  correlation 

function  (7.60)  it  is  evident,  that  this  spectrum  consists  of  two  parts:  discrete 

and  continuous.  The  first  terms  of  (7.69),  not  containing  R  (r0»  after  the  Fourier 

o 

transformation  yield  delta-functions,  i.e.,  these  terms  correspond  to  the  discrete 
part  of  the  power  spectrum  of  the  process.  The  terms  with  R0('i')  correspond  to  the 
continuous  part  of  the  spectrum,  the  terms  containing  the  multiplier  cos  2  ^^cor¬ 
responding  to  the  high-frequency  range  of  the  continuous  spectrum,  and  the  rest  to 
its  low-frequency  range. 

Let  us  designate  by  F^(W)  the  discrete  part  of  the  power  spectrum  of  a  process 
at  the  output  of  a  square-law  detector.  Then  from  (7.69)  we  obtain* 

,  .«««  (7.70) 

+  — 1«  («*  -  2»0  ~  tt)  +  8  (»  -  2^ + 0)] -f 

+  IS- 1*  (•  ~  H  -  2ft)  -t-  8  (•  -  2»0  +2ft)J. 

The  first  term  in  (7.70)  corresponds  to  the  direct  component  of  the  process  at 
the  output  of  the  detector.  The  share  of  the  signal  in  the  direct  component  is  equal 
to  -  (1  +  -2 —  )^,  and  the  share  of  noise  is  o' ^ . 

Besides  this,  the  mean  power  of  ths  beat  between  the  harmonic  components  of  the 
signal  and  the  noise  equal  too-  «0(1  +  -J  )  enters  into  the  composition  of  the 
direct  component.  The  remaining  terms  of  the  discrete  power  spectrum  (7.70)  owe 
their  existence  to  the  mutual  beats  of  the  harmonic  components  of  the  signal  in  its 
passage  through  the  square-law  detector. 

We  pass  to  the  determination  of  the  continuous  power  spectrum.  Let  us  designate 
its  low-frequency  and  high-frequency  parts  by  Fjj(«)  and  Fg(w),  respectively.  From 
(7.69)  we  find 

*  To  each  cos tqr  corresponds  a  semi-sum  of  the  delta-functions  (cf.  Appendix  IV). 

Here  are  written  out  only  those  delta-functions,  whose  arguments  turn  to  zero  with  pos 
itive'  frequencies*  For  preservation  of  the  power  relationships  the  coefficients 
of  these  functions  are  doubled. 
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Fm  («) = Au\  a*  j  /?0  (*)  cos  uxetx  -f 

•  ?  ,  (7.7D 

4-2i£m*3*  i  cos  0- cos -f  4s4  J/?j  (t)cos  =>*/*  = 

•  • 

»  compute  each  item  In  (7.71)  separately.  Since  according  to  our  assumption 
the  spectrum  of  the  noise  at  the  Input  Is  uniform  In  the  band  A  ,  therefore 

.  <*><4. 

o  „>  i. 

Spectrum  F,(e>)  is  uniform  in  a  low-frequency  band  with  a  width  of  A,  ,  eft 
part  of- Pig.  51)."'  alloying  (7.72)  and  beiing.iii  mind  the  condition  that  *  >  2fl 

we  find 

>,(«.) =211’  mV  |  /?*(•)  cos  ttt  cos  = 


(7.72) 


= u\  m*3*J  /?0  W  cos  (•  +  8)  ~r 


or 


4-nJmVj  R0W  cos  (.-«)•*- 

IF,  («  4*0)  +  F\  (•  *“ 


,  0<«*<  4  — O, 

w-U**  •*““<*<  *+B’ 

0.  •>T+0, 


(7.73) 


me*  » 

Spectrum  ? Jp)  is  shown  in  the  center  of  Figure  51 . 
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Let  us  finally  compute  the  third  item,  F^(w).  For  this  ve  employ  the  relation¬ 


ship:*  if  f(tf)  and  ^  (<•>)  are  a  pair  of  Fourier  transformations,  then 

•  1  * 

\P  to  cos  mxdx  =  i  J  0  (tt)  0  (a  u) 


(7.74) 


Assuming  in  (7.7*0  f (**)  *  2o'iR0(r)  and  (w)  =  whenO ,  f(u)-=  O 

when  o)  •  we  obtain  4 

Z  *  1 

\  ^(-)  =  ‘*»4f/?0’(«)cos«»tdT  =  -L  J  = 

.  _  ^  l  — 


-r+* 


0<o»<A, 


(7.75) 


l  °,  •>*; 

Spectrum  Fj(o)  has  the  fora  of  a  right  triangle  with  a  base  the  length  of  A 
(Fig.  51.  right).  Summing  up  F^(<u),  F2(w)  and  F^(oj),  we  find  the  low-frequency  part 
of  the  continuous  spectrum  of  a  process  at  the  output  of  a  square-law  detector  (Fig. 
52,  a). 

It  can  be  seen  from  (7.69),  that  the  terms  corresponding  to  the  high-frequency 
part  of  a  continuous  spectrum  differ  from  the  corresponding  terms  of-  its  low- 
frequency  part  only  by  the  multiplier  cos  ZojQr.  Therefore  FgM  is  obtained  by  the 
shift  of  Fjj(fr>)  into  the  high-frequency  range  ty  2wfl  and  by  its  multiplication  ty  a 
constant,  equal  to  1/2  (Fig.  52,  b). 


Fig.  52.  Continuous  spectrum  of  process  at  output  of 

square-law  detector. 

a)  low  frequency  part,  b)  high-frequency  part. 

222)his  re'J-at,ion3iliP  is  ^  analytic  notation  of  the  convolution  theorem  (compare  p 


F-TS-9811/V 


*  JO*.*-. 


The  full  power  of  the  continuous  part  of  the  spectrum,  as  can  be  seen  from 
Figure  52*  is  evenly  distributed  between  the  low-frequency  and  the  high-frequency 


ranges. 


Components  F1  (<*>)  and  F2(«)  of  the  continuous  spectrum  and  the  corresponding 
items  in  the  high-frequency  range  are  dependent  on  the  beats  of  the  harmonic  com- 


is 


ponents  of  the  signal  with  the  components  of  the  noise  at  the  input  of  the  detector, 
which  fill  band  A  .  This  part  of  the  continuous  spectrum  at  the  output  of  a  detec¬ 


tor  is  sometimes  called  the  continuous  spectrum  of  signal-noise  cross-modulation. 


Component  of  the  continuous  spectrum  and  the  corresponding  item  in  the 

high-frequency  range  are  dependent  on  the  beats  of  any  two  elementary  noise  com¬ 


ponents  at  the  input  of  the  detector,  the  low-frequency  component  being  obtained  on 


I 


the  basis  of  subtractive  combination  harmonics,  and  the  high-frequency  component  on 


the.  basis  of  additive  harmonics.  Since,  with  a  fixed  band  A  at  the  input,  the 


number  of  pairs  of  harmonic  components  with  a  definite  frequency  difference  diminishes 


as  this  difference  is  increased,  the  intensity  of  the  spectrum  under  consideration 


diminishes,  this  diminution  taking  place  according  to  the  linear  law  for  the  rectan¬ 


gular  form  of  the  input  spectrum.  The  spectrum  F^(w)  depicted  on  the  right  side  of 


Figure  51  obviously  coincides  with  the  low-frequency  spectrum  of  the  process  at  the 


output  of  a  square-law  detector,  on  the  input  of  which  there  acts  only  a  stationary 


random  process  (noise  in  the  absence  of  a  sig.iai). 


Comparing  this  spectrum  with  the  spectrum  shown  by  the  broken  line  in  Figure  50. 


we  conclude  that  the  low-frequency  continuous  noise  spectra,  at  the  output  of  a  linear 


and  of  a  square-law  detector,  in  the  first  'approximation  coincide  with  one  another. 


It  is  clear  that,  if  the  action  of  the  filtering  element  of  the  detector  is  taken 


into  account,  the  high-frequency  components  will  be  suppressed. 


The  ratio  of  the  power  of  cross-modulation  to  the  power  of  the  noise  is  equal  to 


UFi  <«0 +  *<«>]*« 


(7.7 6) 
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u 


where  X  is  the  cutoff  voltage, 
o 


An  expression  for  the  power  spectrum  of  a  normal  random  process,  which  has 
passed  through  a  nonlinear  system  with  a  characteristic  of  (?.??)»  may  be  obtained  by^| 
'the  method  set  forth  inSect*  1.  The  indicated  method  is  successfully  used  in  the 


investigation  of  the  half-wave  detection  of  a  stationary  normal  random  process  (cf  *sectj 


.'3).  However,  if  the  normal  process  contains  also  a  determined  part,  then  diffi¬ 
culties  may  arise  in  the  time  averaging  procedure  according  to  formula  (7.9) .  In 
order  to  facilitate  the  solution  of  the  problem,  it  may  prove  useful  to  employ  the 
method  of  contour  integrals,  bearing  in  mind  that  function  (7.77)  permits  a  repre¬ 
sentation  in  the  form  of  (6.62)*. 

Let  us  then  assume,  that  the  characteristic  y  =  f(x)  of  a  nonlinear  system  per¬ 
mits  representation  by  the  contour  integral  (6.62)  and  let  us  return  to  the  general  ^ 
expression  (7.2)  for  the  correlation  function  of  the  random  process  at  the  output  of  | 

a  nonlinear  system,  at  the  input  of  which  there  acts  a  normal  random  process.  J 

1 

Substituting  (6.62)  into  (7.2)  and  changing  the  order  of  integration,  we  find  -J 


*1  C, 

X  f  f  e  **  u~*’) 


(7.78) 


The  double  integral  along  x1  and  x2  represents  a  two-dimensional  characteristic 
function  of  normal  distribution.  Therefore,  employing  (3.95).  we  obtain 


du. 


(7.79) 


#,  <■ 


In  integral  (?.79)  only  the  multiplier  e  contains  the  magnitudes 

=  s(t)  and  a2  =  s(t  +*'),  which  depend  upon  time.  Therefore  in  the  time  averaging 
of  the  correlation  function  B(t',  t)  only  this  multiplier  is  averaged.  Designating 

•,(«,.  -0 = Hm  lf  J  (7.80)  . 


*  Of  course,  characteristic  (7.38)  may  be  represented  in  the  form  of  a  sum  of  two 
characteristics  of  the  (7.77)  type;  fj(x)  +  fg(-x),  and  then  the  method  of  contour 
integrals  may  be  expanded  to  full-wave  detection. 
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we  find  from  (7.79)  the  following  expression  of  the  averaged  correlation  function 
B*(t)  of  a  random  process  at  the  output  of  a  nonlinear  system 

**  M  =i»  J  («“a)*f(«i.“t^)e  *  («i +«“■“« (7.91) 

«i  *$ 

Let  us  assume  that  the  determined  part  of  the  process  constitutes  a  periodic  function 
of  time  with  a  period  of  T.  Approximating  the  periodic  function  S(t)  by  the  first 
N  +  1  terms  of  the  Fourier  series 

*—0 


and  noting  that  the  averaging  in  (7.80)  may  in  this  case  be  made  for  one  period,  we 
obtain  the  following  expression  of  the  function  uz  •  v  ) 


M  .  , 


dt. 


2  nt 


or,  introducing  a  new  variable  v  =  ~~  and  separating  out  the  direct  component  kQ, 


we  find 


"  r  • 

.  *»  1  2  I  M„ew  «*+«,-<„  co.fro  +  ] 

•«(“».  e  ',"‘l  1 


(7.32) 


Vfe  perform  under  the  summation  sign  in  the  integrand  function  the  elementary 
transformations 

«i  cos  /W-Hacos  =  («!+«,  cos  2-~jcosnv  — 

~  sin  ~y~  sin  = ]/"«J + “]  +  %uiu»  cos  cos  (no  4- 

wherein  the  phase  angle  ^  does  not  depend  on  v.  The  expression  (7.82)  may  now  be 
rewritten  in  the  form  of 

•>l.  «1.  *)  = 

H  y— ________ 

I  f  +  (7.83) 

SJ  do. 
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The  integral  in  (7,83)  is. a  sero-order  Bessel  function  of  N  variables 


*)=/<>  (*t,  xa~... XH)  e,^(“,+“») , 
+«5+  2»,* cos?^  («=  i  2, ...  N). 


(7.84) 


A  Bessel  function  of  N  variables  may  be  expanded  into  a  short  series  of  ordinary 
Bessel  functions*,  then 


(#i.  t)  =  e  x 

»  « 

x  E  E 

*■— w  *v—  W 


(7.85) 


where  =  2  +  ...  +Nkn. 

Let  us  examine  more  closely  the  case  of  the  purely  harmonic  signal  S(t)=a  cos 
.  In  this  case  from  (7.85)  we  find 

•,(#!»«*  t)=s4(*i)==<4)(a^«j4-tt*-|-2«,«jCos^.  (7.86) 

Employing  the  addition  theorem,  well-known  in  the  theory  of  Bessel  functions 
(cf. ,  e.g.  G.  N.  Vatson,  "Teoriya  besselevskikh  funktsiy",  For.  Lit.  Pub.  Hse.  1949 
p.  391),fi.e.,  G.  N.  Watson,  "A  Treatise  on  the  Theory  of  Bessel  Functions",  2nd  ed. 
New  Tork,  1944  ]),  it  is  possible  to  represent  (7*86)  in  the  form  of  the  series 

•a 

«*  *) — (—  I )\J„  (<w,)  Jm (aut)  cos  2~t,  (7.8?) 

a-0  1 

where  e  *  1,  £„  *  2  when  n  ^  1 . 

If  now  (7.87)  is  substituted  into  (7.81)  and,  besides  that,  there  is  employed 
an  expansion  of  the  comultiplier  e  9  x  into  the  series 

_£(_!)»  •*<£.  „»  ,  (7.88) 

M 


*  Cf.  M.  I.  Akimov.  On  the  Bessel  Functions  of  Many  Variables.  Leningrad,  1929, 
pp.  47  -  49.  /o  funktsiyakh  besselya  mnogikh  peremennykh.7 
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then  in  the  double  integral  (7.8t)  it  will  be  possible  to  separate  the  variables  of 
integration  and  to  represent  the  correlation  function  B*(‘»)  in  the  fom[  compare 

(6.65)1  of' 

b*  M = f]  fj  (-  'I**  cos  x 


n-0 »*0 


-J 


-“I 


Designating 


••a* 


= -£-* J  *  (#«) « V.  (an)  e  2  du, 


(7.89) 


we  finally  obtain 


«*w=5] 


a— 0*-0 


(7.90*) 


Analogous  computations  for  the  case  when  the  signal  consists  of  two  harmonic 
vibrations 

a»  cos  /  4.  a2  cos  t. 


lead  to  the  formula 


tO  Ot  tO 

«*(')=  SSS  *5=.  (CM  *»/. 

«J-0  i-0  i-0  * 


(7.90  ) 


where 

jai+a+ir  1  _  «*«♦ 

*•*.*  =  — S—J  £(,u)u  /«  (at«)/,(Oj«)e  *  rfa. 

-  « 

Let  us  assume  that  the  power  spectrum  of  the  stationary  part  of  the  process  is 
concentrated  in  the  narrow  frequency  band  about  the  carrier  frequency  coQ  *  of 

the  signal.  Then  the  correlation  coefficient  may  be  represented  in  the  form  of  R(r) 
=  Ro(tr)  cosw^Jcf.  (7.15)]  t  and  from  (7.90)  we  obtain 

~ —  R*  (t)  h*^  cos\*  cos  (7.91) 

»-0  »m0  ,  . 
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Replacing  the  powers  of  the  cosines  by  the  sum  of  the  cosines  of  the  multiple  arcs 
according  to  formula  (7.17)  and  (7.18)  and  effecting  the  same  transformations  as  in 
|2,  it  is  not  difficult  to  transform  (7.91)  into  an  expression  analogous  to  (7.24): 


where 


SB  /  SB 

•  B*W  =  J]«XoCOSrt“ot  (t)cos  no»0t4- 

a-0  a— 0 

-f  ~  V]  J]  «aBir-j.a  (t)  (cos(n+2r-l)u»0t+cos(n-2r+l)»0')]+ 

r&r-\ 

cm  .cm 

■M  EE  W  lcos  ("  +  2r)  »0t  +  cos  (n  -  2r)  »0t]. 


a— Q  r-I 


(7.92) 


i 

i 


v...« =SpSj,f|3  w. 

ft*r 


(7.93) 

(7.94) 
(7.94* ) 


The  power  spectrum  of  a  process  at  the  output  of  a  nonlinear  system  is  obtained 
by  a  Fourier  transformation  of  B*(f).  The  discrete  part  of  this  spectrum  corresponds 
to  the  first  sum  in  (7.92),  while  the  remaining  terms’  of  this  equation  yield  the  ,  i 
continuous  part. 

It  can  be  seen  from  (7.90),  that  determination  of  the  power  spectrum  of  the  sum 
of  a  periodic  signal  and  a  stationary  normal  random  process  reduces,  after  nonlinear 
transformation,  to  the  computation  of  Fourier  transformations  of  the  exponents  of  the 
input  correlation  coefficient  and  of  the  integrals  (7.89),  which  depend  on  the  char¬ 
acteristic  of  nonlinearity  g(iu).  Fbr  the  nonlinear  characteristic 


the  function 


/(«)=/••(*— (7.95) 

'  *•  *<*.  ... 

,  and  contour  c  coincides  with  the  true  axis, 


g(iu)=s££tp1:-t''r 

skirting  only  the  origin  of  the  coordinates  along  a  semicircle  in  the  lower  half  of 


the  plane (Fig.  54).  In  this  case  the  coefficients  (7.89)  are  expressed  as  integral: 
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, .  u  -  . - - -  ri>r - 4  '  -  • 


■■HMMPpniP!^  L  mm 


o 


(  i 


of  the  type  of 


i-  ‘•t-l‘J,,+')l«‘~1^)t  V"-„a. 


(7.96) 


The  integrals  (7.96)  nay  be  computed  by  means  of  the  expansion  of  e"‘*ow  and  Jn(ati) 


into  exponential  series  and  by  the  replacement  of  C=  u^,  after  which  the  problem 

reduces  to  the  computation  of  the  contour  integrals  J  C^e^dC  (contour  c* 

«• 

is  shown  in  Fig.  5^)*  which  simply  coincide  with  the  well-known  integral  represent¬ 
ation  of  the  gamma-function  (cf.  M.  A.  Lavrent'yev  and  B.  V.  Shabat.  Metody  teorii 
funktsiy  kompleksnogo  peremennogo  (Methods  of  the  Theory  of  the  Functions  of  the 
Complex  Variable).  Gostekhizdat,  1951.  p.  373-). 


Fig.  .5*1.  Contours  of  Integration,  c  and  c*. 


7.  Ideal  Signal  Limitation  in  the  Presence  of  Kolse 

As  an  example  to  illustrate  the  contour-integral  method,  let  us  examine  the 
correlation  function  and  power  spectrum  of  a  process  at  the  output  of  an  ideal 
limiter  with  a  characteristic  of 


-’Ho. 


= /«*.(*>*«) 
(*<*o). 


(7.97) 


if  at  its  input  there  acts  the  sum  of  a  harmonic  signal  and  noise  which  constitutes 
a  normal,  stationary  random  process,  the  power  spectrum  of  which  is  concentrated  in 
a  narrow  frequency  band  about  the  signal-carrier  frequency. 

It  is  obvious  that  the  nonlinear  characteristic  (7.97)  is  a  special  case  of 
(7.95)  when  >>=  0,  and  therefore  the  solution  to  the  problem  at  hand  is  provided  by 
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formulas  (7*90),  (7.96)  if  in  them  it  is  assumed  that  P=  0. 

Let  us  first  consider  the  case  when  the  signal  is  absent,  i.e.,  when  a  =  0, 
Then  from  (7.9 6)  it  follows,  that  all  the  coefficients  h^  turn  to  zero,  with  the 
exception  of  the  coefficients  corresponding  to  n  =  0. 

Employing  the  technique  used  on  p.  135,  we  find 


ft^—  JL-*  j  e~ix,udu  = 


rfi,*-1  2*JC  ,e 

When  k*1,  from  (7.98)  we  find  (cf.  Appendix  VII) 


J  l  _  ®  _J»j _ w  /M 

'  '  ■  KS  rfV~‘e  ~  «*-V2k  ^*-1  («)e 


(7.98) 


(7.99) 


To  the  direct  component  of  the  limited  noise  there  corresponds  a  term  equal,  when 


k  =  0,  to 


(7.100) 


where  P  is  the  Laplace  function  (cf»  Section  7,  Ch«  I). 

Substituting  (7-99)  and  (7.100)  into  (7.92)  and  taking  into  account  (7.93)  - 
(7.9^*),  we  obtain  an  expression  for  the  correlation  function  of  normally  distributed 
noise,  which  has.  passed  through  the  ideal  limiter,  in  the  following  form; 


1-x  -4 


•  l2i)  *~l 


(2*)!2“  ’ 


+  [S  Hl*-t  (?)  (X)]C0S  ®o*+ 

“**  22  [23 ^»-*("r)  (2^iy2»-» cos^2r  ~  ^ ®°T+ 
+  S  C0S 2r®»| 


(7.101) 
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From  this  expression  there  can,  by  means  of  a  Fourier  transformation,  be  de-  'J| 
termined  the  power  spectrum  of  limited  noise.  This  spectrum  has  a  form  character-  Jl 
istic  to  nonlinear  transformations,  i.e.,  (besides  the  direct  component)  it  consists  •  j| 
of  a  video  band  and  of  bands  situated  about  frequency o>0  and  about  harmonics  of  that  '-'M 
frequency.  The  energy  distribution  between  the  video  band  and  the  carrier-frequency  -J| 
harmonics  depends  on  the  limiting  level.  -Jl 

Let  us  make  use  of  (7*101)  in  order  to  examine  in  somewhat  greater  detail  the  | 

case  of  low  limiting,  in  which  the  mean-square  value  of  the  noise  amplitude  is  much  ;| 

greater  than  the  height  of  the  limiting  level  xQ or  .  Since  when  k  is  odd  (7.100)  |j 
contains  only  even  powers  of  Xq/  or  ,  and  when  k  is  even  only  such  odd  powers,  there-  .| 

fore  ignoring  the  powers  of  xQ/or  higher  than  the  first,  we  obtain  for  the  case  at  | 


hand 


:  flW=4-('-B;-?)+^-{hw+ 


U  (2n-\)\2-n-2  J  ° 


+s[s'^a^-vW]c«„-.w}+ 

r-l  m-r  r 


(7.102) 


f— I  m-r 


It  can  be  seen  from  (7.102)  that  when  Xq  =  0,  the  spectrum  of  the  limited  noise  «: 

i 

is  concentrated  only  in  the  vicinity  of  the  carrier  frequency  to  and  its  odd  harmonics.^ 

“  %.Q> 

[cf.  the  terms  in  (7.102)  enclosed  in  the  parentheses].  When  xQ  ^  0,  but  xQ  <3C  <y  , 
combination  spectral  components  appear  in  the  video  band,  and  in  the  bands  situated  ff 

about  the  even  harmonics  of  but  the  power  correspond '  ng  to  these  parts  of  the  | 

spectrum  is  much  less  than  in  the  bands  about  the  odd  harmonics  of  O  . 

0  )U 

Figure  55  shows  the  power  spectrum  for  xQ  KfC  or  with  the  condition  that  the  J 
noise  spectrum  at  the  limiter  input  is  uniform  in  band  A  .  The  spectrum  in  the 


i-yj 
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Fig.  55.  Noise  spectrum  with  low  limiting  level, 
vicinity  of  carrier  frequency  <t)Q  is  determined  by  the  Fourier  transformation  of  the 


expression 


(7.103) 


The  firs.t,  principal  term  in  (7.103)  repeats  the  form  of  the  input  spectrum. 

The  difference  of  the  form  of  the  output  spectrum  from  that  of  the  input  spectrum  is 
determined  by  the  succeeding  terms,  whose  influence  is,  however,  insignificant.  The 
form  of  the  spectrum  in  the  vicinity  of  the  carrier  frequency  is  shown  in  Figure  56. 
In  the  same  figure  the  broken  line  indicates  the  power  spectrum  of  noise  at  the 
limiter  input.  It  can  be  shown  that  when  xQ  — *  0  the  area  of  the  section  of  the 
output  spectrum  in  the  vicinity  of  carrier  frequency  U)Q  ,  shown  in  Figure  56,  is 
equal  *0  0.8  of  the  area  of  the  input  spectrum,  i.e.,  20$  of  the  noise  power  becomes 
the  power  of  the  odd  harmonics  of  the  carrier. 

Let  us  note,  that  these  same  power  relationships  are  preserved  with  the  ideal 
limiting  of  a  sinusoidal  voltage,  for  which  xQ  =  0,  since  in  this  case  the  output 
voltage  has  the  form  of  a  periodic  pulse  sequence  with  a  density  of  0.5. 


t  Hr 


Fig.  56.  Spectrum  of  noise  in  vicinity  of  carrier  frequency. 
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With  an  increase  in  the  limiting  level  xj  cr ,  the  distribution  of  power  to 
various  parts  of  the  power  spectrum  changes  substantially.  Thus,  for  instance,  with 
x0  =  O'  the  principal  part  of  the  mean  power  of  the  process  at  the  output  of  the 
limiter  is  concentrated  in  the  video  band  and  about  the  frequency  UQ  ,  the  power  cor¬ 
responding  to  the  video  band  amounting  to  approximately  2 5$  of  the  total  power,  and 
that  corresponding  to  carrier  frequency^  amounting  to  50^  of  the  total  power  (Fig. 
57).  The  same  phenomenon  also  takes  place  in  the  high  limiting  of  sinusoidal  voltage 
here  the  density  of  the  square  pulses  at  the  output  of  the  limiter  diminishes,  and 
with  it  also  the  power  of  the  first  harmonic  of  the  cadence  frequency. 


Fig.  57*  Noise  spectrum  with  high  limiting  level. 

Let  us  consider  what  changes  are  undergone  by  the  correlation  function  and  the 
power  spectrum  if  a  signal  is  present,  restricting  ourselves  to  the  case  when  the 
abscissa  of  the  operating  point  coincides  with  the  cutoff  voltage  (x0  =  0).  Then 
from  (7.96)  there  follows  (cf.  Appendix  VI) 

;jr  v,((»)e  tdu= 

(7.104) 


Kk - <£ — J“  JM(au)e~  tdu= 

= &(9)  W ;p+Fj  *  (^  •  "+>•-£)  • 


Since  with  a  whole  negative  a  gamma-function  is  limitless,  it  can  be  seen  from 
(7.104)  that  hn)<  S  0  when  n  +  k  =  2r  (r  =  1,  2,...).  Substituting  the  expression 
from  (7.104)  into  the  first  sum  of  formula  (7.82),  we  obtain  the  periodic  part 
of  the  correlation  function 


*.W  =  T  +  T- 
XA 


ixit  f  i  (  «  i 

("- T»  **■ ~  £■  )j 


(7.105) 


cos(2n— 
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to  which  corresponds  the  discrete  part  of  the  power  spectrum  of  the  process  at  the 


limiter  output*: 


■-*  l 

r('  -(2n-D-.! 


(7.106) 


If  or — >0,  then  employing  the  asymptotic  resolution  of  a  hypergeometric  functioij 

-  ''  a 

(cf.  Appendix  VI)  and  taking  into  account  that  J 


r(4-«)r(T+*)=£?!(-i)*.. 


from  (7. 105')  we  find 


5T  W  =T  *  M+  t  •  "ST  J)  {STTT7  1HJ, 


which  will  provide  the  power  distribution  in  the  soectrum  of  a  periodic  sequence  of-  \ 

,  ’  'jfl 

square  pulses  with  a  density  of  :  j 

Selecting  from  the  succeeding  sums  of  (7.?2)  terms  for  which  n  =  0,  we  obtain  A 

~  "A 

(deducting  the  direct  comoonent)  a  correlation  function  corresponding  to  the  con- 

tinuous  spectrum  which  is  formed  by  the  beats  of  the  noise  components.  This  cor-  | 

-* 

% 

relation  function  coincides  with  (7.102)  if  ir.  that  expression  the  last  term,  which;,] 
has  the  magnitude  x.  for  a  multiplier,  is  discarded.  The  remaining  terms  of  (7.92)J 

.  i 

in  these  sums  (n>0)  correspond  to  the  continuous  spectrum  which  is  formed  by  the  | 
beats  of  the  signal  and  the  noise  components.  All  the  even  harmonics  in  (7.92)  J 

disappear  in  the  case  under  consideration.  J 

An  explicit  expression  of  the  correlation  function  of  a  random  process  at  the  J 

*3 

output  of  a  limiter,  in  terms  of  the  correlation  coefficient  of  the  noise  at  the  in* 
put  of  the  limiter  and  the  ratio  ,  is  obtained  after  the  substitution  into  (7.921 


*  Cf.  footnote,  p.  275. 
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I?*  *V  ' 


i  < 


of  the  expressions  (7.93)  -  (7«94* )  with  account  being  taken  of  (7.104).* 

8.  Calculation  of  Signal/Noise  Ratio  After  Nonlinear  Transformation. 


%a  a  r- 


The  content  of  many  radio-engineering  problems  lies  in  evaluating  the  influence 
of  interference  on  useful  signals.  For  the  solution  of  problems  of  this  type  it  is 
necessary  first  of  all  to  stipulate  a  criterion,  un  the  basis  of  which  there  can 
take  place  a  quantitative  comparison  of  the  interference-killing  features  of  various 
systems.  The  choice  of  a  specific  criterion  for  the  evaluation  of  interference- 
kilLing  features  depends  on  the  method  used  for  separating  (observing)  the  signal  at 
the  output  of  the  system. 

Very  often  there  is  employed  as  such  a  criterion  the  power  ratio  of  signal  to 

noise  (or  the  square  root  of  that  ratio),  known  for  short  as  signal/noise  and 

c 

designated  as  p  .  For  calculating  this  ratio  there  is  employed  the  theory,  set 
forth  above,  of  the  transformations  of  random-process  power  spectra  in  linear  and 
non-linear  systems.  We  emphasize,  that  the  evaluation  of  interference-killing 
features  by  the  indicated  criterion  required  a  knowledge  of  only  the  most  general 
statistical  characteristics  of  random  processes,  and  not  the  probability  distribution 
of  instantaneous  values. 

Since  a  unit  of  radio  equipment  constitutes  a  series  of  standard  links,  each  of 
which  consists  of  two  linear  systems  with  one  nonlinear  system  between  them,  it  is 
sufficient  to  consider  the  manner  of  calculating  the  signal/noise  ratio  at  the  output 
of  a  standard  link  (Fig.  4-3). 

Let  us  assume,  for  the  sake  of  definiteness,  that  on  the  input  of  a  standard 
link  there  acts  a  signal,  which  is  a  determined  function  of  time,  and  a  noise  which 

*  An  expression  of  the  correlation  function  for  the  case  when. the  process  at 
limiter  input  is  not  a  narrow-band  one,  is  cited  in  [5j  .  WhenxQ=  0  and  under  >.he 
condition  that  the  normal  process  at  the  input  is  stationary,  the  correlation  function 
may  be  represented  ir.  the  form  of 


£ 1  •+■  «c  sin  R  (t)j  . 
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constitutes  a  normal  stationary  random  process.  Since  the  signal  and  the  inter- 
ference  pass  through  the  linear  system  independently,  we  again  have  at  the  input  of 
the  nonlinear  unit  the  sum  of  a  determined  signal  and  of  normally  distributed  noise, 
the  spectra  of  which  are  deformed  according  to  the  frequency  characteristic  of  the  .| 

'  A 

linear  system,  as  was  indicated  in  Section  2,  Ch.  VI.  Therefore  it  is  not  difficult  to  ^ 
compute  the  power  ratio  of  the  signal  and  the  noise  at  the  input  of  the  nonlinear  | 

.  I 

element  (abbreviated:  signal/noise  ratio  at  input).  The  power  spectrum  of  the  process;| 
at  the  output  of  the  nonlinear  unit  has  a  more  complex  structure.  As  has  been  indi-  |j 
cated  more  than  once  in  the  present  chapter,  this  spectrum  consists  of  three  parts. 

<§ 

The  discrete  part  of  the  spectrum  Fc^c(W) corresponds  to  the  beats  between  the  com- 
ponents  of  the  useful  signal.  One  part  of  the  continuous  spectrum,  Fw^u(&?,  is 
formed  by  the  beats  of  the  noise  components,  and  the  other  part,  F  „  (ft>)  is  formed  by  y 

CAUI 

the  mutual  beats  of  the  signal  and  noise  components.  B 

1 

Let  C(o)  be  the  frequency  characteristic  of  the  linear  system  (filter)  which  | 

follows  the  nonlinear  element.  Then  the  power  spectrum  of  the  process  at  the  output  | 
of  a  standard  link  is  equal  to  J 


f(»)=C*  («)  [F4Xc  («)  +  FmXm  («)  +  feXlu  Ml- 


(7.107) 


In  order  to  compute  the  signal/noise  ratio  at  the  output  of  a  standard  link,  it  -|| 
is  necessary  to  decide  whether  the  C^(«J)  Fc^w(0)  part  of  the  output  spectrum  should  | 
be  imputed  to  the  signal  or  to  the  noise.  In  this  connection  there  result  two  |j 

varieties  of  power  criteria  for  the  evaluation  of  interference-killing  features:  -1 

a)  the  beats  between  signal  components  and  noise  are  imputed  to  noise,  I 

\  & 

b)  the  beats  between  signal  components  and  noise  are  imputed  to  the  signal.  f 

I 

The  first  criterion  is  used  in  the  evaluation  of  the  interference-killing  i ; 

?  * 

features  of  communications  systems,  in  which  by  c/n  is  understood  the  square  root  Ij 

|| 

of  the  ratio  of  the  power  of  the  useful  signal  with  interference  absent  ir.  the,  pass  .m 
band  of  the  filter,  to  the  power  of  the  interference  in  the  same  band,  computed  with  || 
the  signal  present.  In  this  case  the  signal/noise  ratio  is  computed  according  to  the  Is 
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\  ) 


T" 


formula 


(t)!= 


where 


p.wrf- 

j^Mdu 

.  (*)  =  C*  (“)  Ftxe  (*)♦ 
*»«*(•>  [Fmxm(»)  +  Ftxm(»)]. 


(7.108), 


In  problems  dealing  with  the  detection  of  a  weak  signal,  concealed  in  noise, 
the  presence  of  beats  between  the  signal  and  the  noise  facilitates  the  detection  of 
the  signal,  and  .'the  employment  of  the  second  criterion  may  prove  more  expedient.  In 
this  case  the  signal/noise  ratio  is  computed  according  to  the  formula 


f  f.  («)  rf«  +  C  Fal  («)  dtt 
/  J\*  __  J  6 

\Bh 


(7.109) 


where 


|  F&  (»)<*» 


F»=C»(«)Filx». 


9.  Power  Spectrum  of  Quantization  Noise 
Along  with  the  quantization  of  signals  by  time*,  an  effective  means  of  augment¬ 
ing  the  interference-killing  features  of  radio  equipment  is  the  quantization  of 
signals  by  amplitude.  In  this  case  the  entire  continuous  dynamic  range  is  divided 
into  a  series  of  discrete  levels.  The  signal-quantization  mechanism  at  the  trans¬ 
mitting  end  reduces  to  the  transmission,  in  place  of  a  given  instantaneous  signal 
value,  of  the  value  of  the  discrete  level  closest  to  it. 

The  quantization  of  signals  by  amplitude  makes  possible  the  effective  suppression 
of  interference,  if  only  the  mean-square  value  of  the  interference  is  small  in  com¬ 
parison  to  the  difference  between  the  discrete  levels.  Quantization  leads  to  signal 
distortions  which  are  called  quantization  noise. 

Signal  quantization  by  amplitude  forms  the  basis  of  all  pulse-code  modulation 


*  cf.  footnote,  p.  163. 
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gs 

* 

_  __  tB^t^ttJWWJty^np^1^-.^..--,  ,..t|  t  ,  |  _ _ 


)f 


)  * 


*3 


A/k 


{\^/\y2  f 


Fig.  53.  Non-linear  network  with  sawtooth  characteristic. 

(P-C.M.  t-sic.  IKM]  )  systems. 

Let  us  determine  the  correlation  function  and  power  spectrum  of  quantization 


noise,  assuming  that  the  signal  is  a  normal  stationary  random  process  with  a  zero 

1 


mean,  a  dispersion  of  O'  and  a  correlation  coefficient  of  R(J'). 

The  quantization  error,  i.e.,  the  difference  between  the  initial  and  the 
quantized  signal,  may  be  regarded  as  a  result  of  the  transformation  of  an  initial 
signal  in  the  nonlinear  system  with  a  saw-tooth  characteristic,  shown  in  Figure  58 


/(*)=*  — m3,  —  -J-)8<x<(m  + 

m~0,  rfc  l,  it  2, . .. 


(7.110) 


where  8  is  the  distance  between  the  discrete  levels. 

Employing  (7.2)  and  taking  into  account  (7.110),  we  find  the  following  express¬ 
ion  for  the  correlation  function  B(3*)  of  quantization  noise 

*M=S-FR?E  S  I  I 


(7.111) 


X  (*j  —  m,5)  e  ^  dxydx* 

Effecting  a  replacement  of  the  integration  variables 


X\— 

« 


and  designating 


t'¥r. 


Xt  — *  —  2  y 

we  obtain 


'I 
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•«-£  E  S^TTfif** 

•  -ob*,— o»  — 1  -1 

|  **+"*2+«ii(*-#y)+m*(y-ft*)— 

T  i-«*  " 


r  «-*• 


Xe 


or 


+t+t 

-i—i 


f  X^y*  — »*xy 

-r  *-*■  rfjtrfy. 


(7.112) 


where 


i(*.y)=  S  S'’ 


|  «*+  mj+/n,(x-«y)  f  m,(y-*x>-l*m,m, 

~  1=5* 


(7.113) 


*!-— OB  Bit* 


The  summation  indices  in  the  expression  of  function  L(x,y)  may  be  separated  by 
effecting  the  replacement 

mi-|-ma=rt|,  m,—  maz=n2. 


(7.114) 


The  new  indices  n^  and  n2  also  vary  from  -oo  tooo  ,  but  they  must  be  either 


both  even,  or  both  odd.  After  substituting  (7.114)  into  (7.113)  and  after  the 
simplest  of  trar.sformat-.  sr.s,  we  nave 


M*,y)=  5j  e"4* 

•  » 

+  s*‘ 


J  2 

•e  y  fet(x4-y)+<"i  as  y  2"i(*-yH  <«» 


»+* 


2  « T  + 


f  tt*i+!)<«+y)+(2/ii+t)*  «o  I  (ta»4.1)(x — y> 

i+*  2  e"4  ‘-R 


**•—00 


The  integration  variables  in  integral  (7.112)  may  now  also  be  separated,  for 
which  it  is  sufficient  to  effect  the  replacement 


(7.115) 


x=o-f o,  y=u^v. 

The  transformation  Jacobian  of  (7.115)  is  equal  to  two,  and  the  area  of  integration 
in  the  plane  (u,v)  is  a  rhombus  bounded  by  the  line  u  +  v  =  +  1.  In  virtue  of  the 
full  symmetry,  integration  may  take  place  only  with  respect  to  positive  values  of 
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I  I 
'  -* 


l  '* 


L  -  — *  •««.<*.  A&V-*, 

Baubi 


m 


variables  u  and  v  (one-fourth  of  the  rhombus),  the  amount  of  the  integral  being 
multiplied  by  four.  In  this  manner  we  obtain 

ti—tt  \ 

‘  [l+K  l-H)^ 


*<'>=, -ifej  | 


X 


jgijgMjjgi)  eo  frJUo+fa,) 


■  M 


m+R) 


*u—/o 


+ 


(7.116) 


* t- 

40+«  £  e-  «»-*>  Uudv. 

«l—»  *»■ 


+  S 


Additional  simplification  of  expression  (7.116)  may  be  attained,  if  the  sums 
entering  into  it  are  transformed  by  means  of  the  Poisson  formula  (cf.,  e.g.  B. 

Van  der  Pol'  and  Kh.  Bremmer.  Operatsionoye  ischisleniye  na  osnove  dvukhstoronr.ego 
preobrazovaniye  Laplasa  (i.e.,  Balth  Van  der  Pol  and  H.  Bremmer,  "Operational  Calculus  3 

i  ,4 

3ased  on  the  Two-sided  Laplace  Integral"  [n.  Y. ,  1950  ]  ).  For.  Lit.  Pub.  Hse.,  1352,  ,| 

P.  131): 


£*(«)=  S  ^h(x)^HXdx. 


*— 00  —oo 


Employing  this  formula,  we  find 


It  tf(«  -f»i) 


*  «• 


Analogously 


£  e  ,+*  =y*Ii±*>eT,+*X 

* 

00  r*«»(t+R) 

X[l+2j]e"  *  cos^j. 

f- 1 

J]  e"  =  /jliLp*V  l"«X 

•t— « 

•o 

X[,+2S*-  * 

r-I 

«  fMt4- 1)  »  (t  «+  to.-H)  _  f  «» 

e~  m+R)  -y  «U  +  R)c*TiT^ 

*  oo  rUtjl+Rt 

x[l+25J(-,),e’  *  co.  f]. 


(7.117) 


(7.118) 


(7.119) 


r-I 


I 


I 
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J 

A 


•  _  Pft.+DWfr+in.-M)  _ _  ,  . 

y  e  «*-*>  —  |/ 

•  rHHl-K) 

X[l  +  2J(-I)'e  *  cos-^]. 


LJL 


(7.120) 


Substituting  (7.11?)  -  (7.120)  into  (7.116) ,  and  noting  that  the  exponential 
factors  in  these  sums  cancel  out  with  the  exponential  factor  of  the  integrand 


function,  after  elementary  transformations  we  obtain 

| («*-°*)lM  1  +*.  -#.»)+ 


(7.121) 


where  i*  designated 


rt«Vi 


/,(«.,)=, l+2j]e~  cos , 

r-l 

°®  r»«fa 

/a  (a.  *)  =  1  -{- 2  (—  l)re""  * 


cos 


r~l 


/•*? 
2  • 


(7.122) 


(7.123) 


Now  the  integration  in  (7.121)  may  be  brought  to  a  conclusion  with  no  particu¬ 
lar  difficulties,  since  the  integrals  subject  to  computation  are  tabular.  Omitting 
the  algebraic  transformations,  we  cite  the  final  rervlt 

o*  4/ir*’ 


•«-${  2-*°'-*™*+ 

l  ft-1 


»)-l  *1- 1 


"a 


sh 


4  (ft*  —  ftj)  k*R 


(7.124) 


-2  S?  f\*  7  Tye 

S'r”1)  "vr,“  v 

4  [(*» — t)*  ~  (w»  ~  )*]  *l/?  | 


X*h 

Let  us  assume  that  the  difference  &  between  the  discrete  levels  is  much  less 
than  the  mean-square  value  cf  of  the  signal.  This  a...  sumption  is  almost  always 
realized.  Then  ji  .  Taking  this  last  inequality  into  account,  it  is  possible 
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in  (7.124)  to  neglect  the  double  sums  « compared-  with' ‘the-  first  sun,  and,  replacing  the 
hyperbolic  sine  by  its  asymptotic  expansion,  we  obtain  the  following  approximate  ex¬ 
pression  for  the  correlation  function  of  quantization  noise,  sufficient  for  most 
problems  of  practical  interest 


(7.125) 


The  full  power  of  the  quantization  noise  (the  dispersion  of  quantization  error) 


is  equal  to 


BIQ)=*~  V-L  —  fi!  45 

'  '  2 rt*  2k*  ‘  6  —  Tsf » 


(7.126) 


i.e,,  one-twelfth  of  the  square  of  the  distance  between  the  discrete  levels.  It  is 
not  difficult  to  notice  that,  in  the  case  under  consideration,  the  dispersion  of 
error  coincides  with  the  dispersion  of  a  random  variable  uniformly  distributed  over 
the  interval  of  from  0  to  8  .  This  is  so  because  with  a  small  difference  between 
the  discrete  levels,  the  quantization  error  is  sufficiently  closely  approximated  t ry 
segments  of  straight  lines  (with  the  exception  of  those  cases,  when  the  signal 
between  the  discrete  levels  passes  through  the  extreme). 

Let  us  determine  the  power  spectrum  F(w)  of  the  quantization  noise  with  the 
assumption  that  the  spectrum  of  the  initial  signal  is  uniform  in  band  A  .  The 
correlation  coefficient  of  such  a  signal,  is  in  accordance  with(o.lS),  equal  to  R(T)= 
-§iS— —  ,  Then  from  (7.125),  employing  Khinchin’s  theorem.,  we  find 


*  ,  »  _ /,  tin \ 


cosut  dx. 


(7.127) 


0 


.  _ _  -  .  _ 

^f^Expanding  —  into  a  series  and  restricting  ourselves  to  the  first  two  terms 
(which  is  permissible,  since  the  integrand  functions  in  (7.127)  diminish  rapidly 
with  an  increase  in  the  magnitude  of  fA),  we  obtain 
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00  2it»r.* 


0 


(7.128) 


The  integrals  obtained  under  the  summation  sign  have  already  been  encountered 
above  (cf.  p.  228).  Substituting  in  (7.128)  the  magnitudes  of  these  integrals,  we 
find  the  power  spectrum  of  quantisation  noise  in  the  fora  of 


f(«0  =  ?iil/3i  V~e" 
.  *»A  V  2*  2j 


(7.129) 


The  correlation  time,  in  accordance  with  (5*32)  and  (5.47)  is 


„  _  m  _L  —  iLt/lE.J- 

*0 —  4B(0)  _*»Ar  2*  La  n *  25.8  f  2it  A  * 


,  _  Vi  __  ±_ 

4A  ~~4s\' 


(7.130) 


i.e.,  the  correlation  time  of  the  quantization  noise  is  approximately  2 times 
less  than  that  of  the  initial  signal.  When  p  <^Ct  .-correlation  between  the  quanti¬ 
zation  errors  in  the  consecutive  selections  of  signal  values  is  practically  absent. 
Accordingly,  with  a  reduction  of  the  distance  between  the  discrete  levels  the  power 
spectrum  of  the  quantization  noise  becomes  uniform  in  a  wider  frequency  range,  with 
a  simultaneous  decrease  in  the  maximum  of  spectrum  density. 
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Chapter  VIII 

STATISTICAL  CHARACTERISTICS  OF  THE  ENVELOPE  AND  PHASE  CF  A  NORMAL  RANDOM  PROCESS 


1.  Formulation  of  the  Problem,  and  its  General  Solution. 


is  ! 
It  I 
fc 


m  i 


S'  S  ! 


^ 1  * 

?y  I  i 


Let  us  examine  a  narrow-band  linear  system,  at  the  input  of  which  there  acts  a 
determined  process  (the  signal)  together  with  a  stationary  normal  random  process 
(noise). 

In  accordance  with  the  results  of  Sect.  5,  Ch.  VI  the  stationary  process  at  the 
output  of  a  narrow-band  linear  system  with  a  resonance  frequency  of  <*>_  may  be  repre¬ 


sented  in  the  form  of 


A  (t)  cos  vj  C  (t)  sin  wj. 


where  A(t)  and  C(t)  are  independent,  stationary  random  functions  which  have  normal 
laws  of  distribution  with  zero  mean  values,  dispersions  of  orZ  and  correlation  coef¬ 
ficients  of  R0  ( t ). 

Let  the  signal  3(t),  which  has  passed  through  a  linear  system,  consist  of  a 
high-frequency  vibration  of  the  frequency  coq,  modulated  ty  amplitude  and  by  phase, 

i.e. , 

S(/)=«(Ocosu*0/-t-e(/)sinw0/.  v 

Then  the  random  process  of  the  linear  system  under  examination  is  described  by  the 


random  function 


1(0  =  ({-4  (/)  +  U  (01  cos  4-  \C  it)  +  p  (01  Sin  «„/, 


which  may  be  represented  in  the  form  of 


l(0=£(0cos[.0<-H(01, 


(3^1) 


(3.1*) 


where  E(t)  and  <j>  (t)  are  the  envelope  and  phase*  of  the  random  process  £ (t),  defined 

*  In  some  works  (cf.  e.g.,  [l]  )  by  the  phase  of  a  process  is  meant  the  sum  + 

In  avoidance  of  error  it  should  be  kept  in  mind,  that  here  by  phase  is  meant  only  the 
random  function  ^  (t), 
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mi  i 


r-'  :  ■ 

W\  i 


by  the  formulas 


£(0=^  HW+«  (OP + lc  (0 + o  (OP. 

t<0=-rctg^f. 


(8.2) 

(8.2*) 


In  many  applications  considerable  interest  is  afforded  by  the  problem  of  deter-  '  ;| 

!  I 

mining  the  distribution  functions  of  the  envelope  E(t)  and  phase  <P  (t)  of  the  normal  '1 

■  ‘J& 

random  process  (8.1),  a  general  solution  of  which  is  indicated  in  Sect.7»  Ch*  VI.  § 

I 

f| 

Formulas  (o.?9)  and  (6.30),  there  cited,  provide  a  basic  solution  to  the  indicated  | 

:  % 
■ 

problem.  For  this  it  is  sufficient,  to  insert  the  explicit  expressions  of  n-di-  1 

'i 

mensional  distribution  functions  in  place  of  w^  and  w^.  The  practical  application  | 

-3 

of  these  formulas  is  complicated  by  a  considerable  difficulty  in  the  computation  of  | 

| 

the  participating  integrals.  We  shall  limit  ourselves  here  to  obtaining  the  dis-  f 

1 

tribution  functions  of  the  first  two  orders.  |j 

H 

2.  Distribution  Functions  of  the  Envelope.  1 '% 

The  problem  of  obtaining  the  first  distribution  function  of  the  envelope  of  a  | 

normal  distribution  function  -  (3.1)  coincides  fully  with  the  problem  solved  in  Sect,?,  if 
Chapter  III  of  the  probability  density  of  the  length  of  a  plane  vector,  the  com-  II 

ponents  of  which  are  independent  and  are  normally  distributed  with  parameters  of  J| 

[u(t),  o']  and  [v(t),  $■]  ,  where  cr  is  the  dispersion  of  the  stationary  part  of  process  |§ 

•NS 

6(t).  Employing  (3*33) ,  we  write  the  first  distribution  function  of  the  envelope  fj 


■*»  / 

•  a 


W|(r,  /.[2^]. 

r>0 

W,(r,/)-0.  r<0. 


(8.3) 


where 


«*(/)=#*(/) 


Thus,  the  first  distribution  function  of  the  envelope  of  a  normal  process  coin¬ 
cides  in  the  general  case  with  the  generalized  Rayleigh  law  of  distribution.  This 
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function  for  various  fixed  values*  of  <x/r  is  shown  in  Figure  24.  As  the  ratio  <*/<r 
is  increased,  the  distribution  law  of  the  envelope  approaches  the  normal  [cf.  (3.^0  j. 

When  the  signal  is  absent  (tt  =  0),  the  distribution  law  (3.3)  turns  into  an 
ordinary  Rayleigh  distribution  law  (corresponding  in  the  indicated  figure  to  the 
first  curve  on  the  left) 


W,<r)=-£e“*\  r>0, 
W,(r)=0,  r <0. 


(8.3*) 


The  integral  distribution  law  of  the  envelope,  i.e.,  the  probability  that  E(t) 
does  not  exceed  a  given  magnitude  f  ,  follows  directly  from  (8.3) 


P(£<r(=-^fre  - 


Integrating  by  parts  and  employing  the  relationship 


we  obtain 


\u*tm(au)du=u-IH(au). 


/»-Hf  o* 


<8.*) 


The  curves  of  the  integral  distribution  law  (8.-)  were  shown  in  Figure  f-5. 

Passing  to  the  determination  of  the  second  distribution  function  of  the  envelope 
of  a  normal  process,  we  shall  restrict  our  detailed  computations  to  the  case  where 
the  signal  is  absent. 

Employing  (5.?4)  and  (6.7?)  when  n  =  2,  we  obtain  the  desired  two-dimensional 


distribution  function  of  the  envelope 


.  *  r\fi 

Wi^l.  V)  — 


JeJe 


r*-2ff,r,r,  co*  (»,-»,)  fr* 


Ml -**> 


</0|d8j' 


:(2«*J»(l-#2> 


K»r>r,cM  («,-<»,) 

“  **«l-*2>  •’U-**! 

e  ^  fie  d0,d0„ 


(8.5) 


_ _  r,  >0,  r,  >  0. 

*  I.e.,  for  the  fixed  instant  of  time  t  =  t*;  thereafter «(t)  should  always  be  con 

sidered  in  a  fixed  instant  of  time. 
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For  computation  of  the  double  integral  in  the  right  part  of  (8,5)  it  is  use¬ 


ful  to  effect  a  replacement  of  the  variables 


it  -  a _ 

V2  •  Vi  ’ 


(3.6) 


which  corresponds  to  a  rotation  of  the  coordinate  axes  through  an  angle  of  45° 
(Figure  59).  It  is  not  difficult  to  satisfy  oneself  that  the  transformation 
jacobian  of  (8.6)  is  equal  to  unity. 


M 

»£ 


wT 


<  i 

\  i 


Fig.  59.  Rotation  of  the  coordinate  axes. 
First  integrating  along  -.'(Figure  59).  we  find 

*«r,f,  co*  (»,  —  *»t) 

,  **  «•-!>&  d«,de,= 

Hi  .  ___ 

R/.r,co»  u*2 

_  2  f  fe  *  dodu— 

—  t2*i«  3  3 

o  —«  ., , 

-fcl  <*+*>«  *  *• 

.►T  sar*«— T  v.r,co.» 

=^r.  f  ire 


jye 


(8.?) 


The  replacement  of  y  =  z  +r*  resulted  in  two  integrals,  one  cf  which,  by  virtue 
of  the  oddness  of  the  integrand  function,  is 


f 


dz= 0, 


and  the  other  (cf.  Section.  5*  Chapter  III)  is  equal  to 


tea— 1 
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Thus  we  obtain  the  two-dimensional  distribution  function  of  the  envelope  of  a 
stationary  normal  random  process 

r*+r* 


rtrt 

•HI  -#?,)' 


Wj(rtl  r1(  x)=  e 


/, 


[Vi^i 

-#5)] ' 


'i>0.  r,». 


(8.3) 


When  f 


W,(r,.  r„t)  =  0,  r,<0,  r,<0. 

,  ft  — *  O  ,  and  from  (8.8)  there  follows 

°  ,3 

W,(rt.  r„eo)=Ar^-e^, 


i.e.,  the  two-dimensional  distribution  function  is,  as  was  to  be  expected,  equal  to 
the  product  of  the  ordinary  Rayleigh  distribution  functions  which  represent  the  one¬ 
dimensional  probability  densities  of  the  envelope  of  a  stationary  normal  random 
process  for  V-*  oo. 

The  general  expression  for  the  n-dimensional  distribution  function  of  the  envel 
ope  of  a  stationary  normal  process  has  been  obtained  in  £9]  in  the  fora  of  a  product 
of  exponential  and  Bessel  functions. 

The  case  when  a  regular  signal  is  present  is  considered  analogously,  although 
the  computations  turn  out  to  be  more  cumbersome.  Here  there  will  be  cited  only  the 
final  expression  of  the  two-dimensional  distribution  function  of  the  envelope 

r»+,2+ 

X 


W,(r,.  r,.  x,  t) 


—  'i'i 


Mi-**) 


(8.9) 


vVi  /  i/  r-a=*a . r.i i  r «» -*■>«»  ri 

‘J  •»(!-«»)  *j 


where  oc  =  *  (t),  *  *  * (t  +  v ),  and  »  1  ,  £  »  1  with  m>0. 

If  the  signal  constitutes  a  harmonic  vibration  of  the  frequency  u  and  the  ampli 

O 

tude  uQ,  then  ^  *  ax  ~  uo'  an<*  ^ron  there  follows 


W,(r,.  r„  t) 


_  » 


;  ewwx 


When  ? 


•<(1  -#£> 

m 

xY»  /  f— fry*  ,1/  r  “ofi  1/  r  ** »  1 

"  * 1 0* (1  -  Rl) J  '"L«i(I+/?q)J  V* (*+*•)]* 
,  R  — *■  0  and  from  (8.9)  we  find 


(8.9’) 
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X 


J 


^•l  *a 

w,(f„r,.  /)=•£.'  ‘'/,(^).-ar  ‘•~/«,(^), 

i.e.t  the  two-dimensional  distribution  function  is  equal  to  the  product  of  the  one¬ 
dimensional  distribution  functions  (8.3). 

3.  Correlation  Function  of  the  Envelope 


Having  the  expressions  of  the  two-dimensional  probability  density  of  the  envel¬ 
ope,  it  is  possible  to  find  its  correlation  function,  since  the  latter  is  a  second 
nixed  moment  of  distribution.  To  compute  in  this  connection  the  double  integral,  it 
is  expedient  to  employ  the  method  set  forth  in  Sect.  6,  Ch.  VI,  of  expanding  the  two- 
dinensional  probability  density  into  a  series  of  the  respective  orthogonal  poly¬ 
nomials. 

Let  us  examine  in  detail  the  sequence  of  determining  the  correlation  function 
of  the  envelope  of  a  stationary  normal  random  process.  The  two-dimensional  dis¬ 
tribution  function  is  here  determined  by  formula  (8.8),  and  the  one-dimensional  dis- 

r» 

T  "** 

tribution  corresponding  to  it  —  by  formula  (3.3).  If  the  function 

over  the  interval  (0,co)  is  taken  as  a  weighting  function,  then  to  this  weighting 

/('/>)  (  r* 

function  there  corresponds  the  aggregate  of  orthogonal  La guerre*  polynomials  Uj 
The  expansion  of  two-dimensional  distribution  function  (8,8)  into  a  series  of 
these  polynomials  has  the  form  of 


Employing  expansion  (8.10),  we  represent  the  correlation  function  of  the  envelope  by 


*  8y  definition,  the  Laguerre  polynomials  are  equal  to 

'  Ax*  ' 

(cf.  V.  L.  Goncharov  "Teoriya  interpelirovaniya  i  priblizheniya  funktsiy*'  (Theory  of 
Interpolation  and  Approximation  of  Functions),  Moskva,  Gostekhizdat,  195*0. 
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1 


the  series 


B0  (t)  = j  j  rtr 2tt'j  (r,.  r„  t)  dr,rfr2 = 


=S-S4n^;^,(4.)c'(4.) 

*-o  o  o 


« 


■2l* 


e  *‘  dr{dra. 


and  since  the  variables  in  the  double  integral  are  separable, 

~  R~*  “  " 

i 

K-0 


or 


••0  <1 

BoW=°’|SCWc-* 


(8.11) 


••0 


(8.12) 


where 


c.= 


-*}*S“(4Kf*- 


(8.12*) 


The  computation  of  integral  (8.12* )  is  carried  out  very  simply,  if  use  is  made 
of  the  link  which  exists  between  the  Laguerre  and  the  Hermite  polynomials  (cf.  V.  I 
Smirnov,  Kurs  vysshey  matema tiki  (Course  in  Higher  Mathematics),  V.  IIIi  part  II, 
GITTI,  1949,  p.  576): 

•  C  (4  )=<-'>' 


(8.13) 


Then 


<*„  = 


< — *y*  f  rtu 

- j  \X  nUi,i 

2 "+ln!  J 


(x)c  2dx  — 


«+;- 


dx 


n! 


and  integrating  by  parus  twice,  we  find* 


C*  —  ^  "*»-* '  }  ~  2"n! 

n>2. 


(8.14) 


For  n  s  0  and  n  =  1  it.  follows  directly  from  (8.12*)  and  (8.13)  that* 


m  .  *  Jl* 


•  c.=/2|4*~  ‘dx=y2jyt-'dy^n 


(8.14*) 


^  C| — — ■  (x*  —  3x)  e  2  dx~^l  — 


*  cf.  Appendix  VII « 
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M  2 


(8.14" ) 


Substituting  (8.14)  -  (8.14*)  into.  (8.12),  we  obtain  the  expression  for  the  cor¬ 


relation  function  of  the  envelope  of  a  stationary  normal  random  process 


B, 


«-*(• +-?■+§  J£s««r). 


(8.15) 

which  coincides  (with  an  accuracy  to  the  last  constant  factor)  with  (3.?4)*.  This 
correspondence  is  to  have  been  expected,  since  the  power  spectrum  of  the  envelope  is 
the  low-frequency  part  of  the  spectrum  of  a  stationary  normal  random  process  after 
its  linear  detection. 

For  the  case  of  a  harmonic  signal  present  with  an  amplitude  of  uQ,  the  cor¬ 
relation  function  of  the  envelope  has  been  computed  in  [2]  and  has  the  following  form: 


*0  at 


B0(t)  =  235(l^/^)*e  ** 


3?  yi  (2m)!  [(2w  4- !)!!!» 


m-0 

y  »y~  (4j-*,)"x 


X 


2 m 


(8.15)  fsi 


n  — 0 


XFi(^n  2m  2,  n  +  I,  1  2a») • 


4.  Nonlinear  Transformations  of  the  Envelope.  The  Square-law  Detector. 

It  has  been  noted  in  Sect.  7,  Ch.VI,  that  the  random  process,  obtained  by  the 
nonlinear  transformation  of  a  narrow-band  random  process,  may  be  represented  by  the 
series 


where 


*1  (0  —  f9(£)  -f/i  (£)  cos  (V  —  <p  (/)]  _j_ 
+f«  (£)  cos  (2 <y  -  2?  (/)J  4- . . . , 


* 

1* ( E cos *) cos ntyt'l  («0=  1.  *,=2,  n > 0). 


Sach  of  the  components  of  random  process 7|(t)  is  of  the  same  nature  as  random 
process  £(t),  i.e.,  represents  a  product  of  the  slowly  changing  envelope  fn(E)  by  ® 


ft) 


*  The  indicated  correspondence  becomes  obvious,  if  under  the  summation  sign, 
is  replaced  by 
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cos  n  1<V — f(0I*  the  power  spectrum  of  fn(E)  being  principally  concentrated  in 
the  frequency  range  close  to  n  In  particular,  the  spectrum  of  f0(E),  as  well  as 
the  spectrum  of  E,  is  concentrated  in  the  range  of  low  frequencies  adjacent  tot»>  =  0. 

It  is  of  interest  to  obtain  the  first  two  distribution  functions  of  the  random 
process  fQ(E),  which  is  obtained  as  a  result  of  the  nonlinear  transformation  of  the 
envelope  of  a  normal  random  process.  For  this  it  is  sufficient  to  effect  the  ap¬ 
propriate  replacement  of  variables  in  (3.3)  and  (8.9)  according  to  the  formulas  of  ' 
Sect*  1,  Ch.  III. 

Let  us,  for  example,  consider  what  will  be  the  distribution  functions  of  the 
envelope  of  a  narrow-band  normal  random  process  after  square-law  detection.  In  the 
case  under  consideration 


(3.16) 


Let  us  begin  by  determining  the  two-dimensional  distribution  function  of  E2(t). 
The  problem  is,  in  formula  (3.9)  to  make  the  transition  from  the  variables  r1  and  r^ 


to  the  variables 


2  J 

Pi—rit  h—r2‘ 


(8.17) 


Although  the  inverse  function  r  =  +  'Jf  is  two-valued,  nevertheless,  since 
>0,  r2  >  0,  to  each  point  in  the  plane  (p^  ,  p  x  )  there  will  correspond  only  one 
point  in  the  plane  (r^,  r2).  The  transformation  jacobian  of  (6.17)  is  equal  to 

*(n.Pi)  _-|2r,  0  I  4 

W  I  0  2 r,p4r,r*- 


Employing  (3.10)  and  taking  into  account  that 


*(n.  rt)  __  I 
<*(Pi.h)  *Vt\ 


we  obtain 


the  two-dimensional  distribution  function  of  the  square  of  the  envelope 

Mf»+  «i+  «|-**i*i*. 


Wjfru  p„  t, /)—  e 

f»>0* 
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(8.18) 


(8.20* ) 


The  distribution  function  corresponding  to  it  is  equal  to 

j  W|«=ie“sr.  P>0, 

This  is  the  so-called  exponential  distribution. 

The  two-dimensional  distribution  function  of  the  square  of  the  envelope  may 
alco  be  obtained  by  the  method  of  characteristic  functions  (cf.  Sect,  7,  Ch.  7I)» 

Thus,  in  accordance  with  (6.81),  the  two-dimensional  characteristic  function  of 


the  square  of  the  envelope  of  a  stationary  normal  random  process  is  equal  to 


ae  os  a,  as 


>  —00  —00  — 00 


J  f  Vy-t 


-Nfcr ;  S 


dxidxidylily2=.-. 


(8.22) 


e  '  1  , '  ’  r  e 


dXidxA , 


i.e.,  to  the  square  of  the  integral 


2*3*  Y 


Q»  00 


+  e  !,,<1  dxxdx2- 


(8.23) 


V I  —  2ia*  (»t  U,)  —  4j<  (1  —  /?5)  Vjt’j 

A  detailed  computation  of  integral  (8.23)  is  cited  in  Appendix  V. 


Consequently, 


02 ^  I  - 2*3*  (tq  +  vt)  —4*4(1  —  Rl ) 


0>  Wt 


(8.24) 


Effecting  in  (8.24)  an  inverse  Fourier  transformation  (cf.  Appendix  VIII),  we 
obtain  a  second  distribution  function  of  the  envelope  of  a  stationary  random  process, 
differing  in  no  way  from  (8.19),  The  case  where  a  regular  signal  is  present  may  be 
marked  out  in  an  analogous  manner.  It  is  clear  that  for  the  investigation  of  the 
distribution  functions  of  the  square  of  the  envelope,  direct  replacement  of  the 
variables  in  (3.9)  is  more  simple  than  the  employment  of  the  method  of  characteristic 
functions.  However,  with  more  complex  nonlinear  transformations  of  the  envelope 
f0  (E),  when  a  function  inverse  to  f  cannot  even  exist,  the  method  of  characteristic 
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functions  becomes  one  of  the  most  effective  procedures  in  solving  the  problem. 

Having  the  expressions  of  the  two-dimensional  probability  density  of  the  square 
of  the  envelope,  it  is  possible  to  find  its  correlation  function,  employing  for  this 
purpose  the  method  of  expansion  in  terms  of  orthogonal  polynomials.  As  an  example, 
let  us  determine  the  correlation  function  of  the  square'  of  the  envelope  of  a  station¬ 
ary  normal  random  process,  the  two-dimensional  distribution  function  of  which  is 
given  by  formula  (8.19),  and  whose  one-dimensional  distribution  function  is  equal  to 

_  t 

1  e  **  when  p  >  0.  If  this  one-dimensional  distribution  function 

2a*  r 

is  taken  as  a  weighting  function  over  the  interval  of  (C,co),  then  to  it  will  cor¬ 
respond  the  aggregate  of  orthogonal  Laguerre  polynomials  *?(*•)  1  (cf.  footnote  on 
P.  306).  ‘  ’ 

An  expansion  of  the  two-dimensional  distribution  function  (3.19)  into  a  series 
of  these  polynomials  has  the  form  of 


_  fi  -*•  ft 

1  , 


UTm_1 _ 

Lo»(I  _/?2)  J  ~ 


=  — e  ** 

**  c  L°  [w)Ln  [la)- 

Employing  (8.25),  we  represent  the  correlation  function  of  the  square  of  the  envel¬ 
ope  by  the  series 


(8.25) 


B, 


ft  4*  Pi  Q» 


wnere 


*--wf 


~4r  [*L?(x)t~'dx. 


(8.27) 


Employing  the  definition  of  the  Laguerre  polynomials  (cf.  footnote  on  p.  306),  it  is 
not  difficult  to  compute  integral  (8.27): 
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j^(x"e  V*= 


,4, 

& 


‘  % 
x 


Consequently,  in  the  series  (8.26)  only  the  first  two  coefficients,  cQ  and  c2  differ 
from  zero;  these  are  computed  independently,  remembering  that  (x)  =  1  and 
l|°^(x)  =  1  -  x 

Ca— 


—  j  xe  Xdx=  1,  r,=Jx(l  —  x)e“Jrfx==  —  I. 


Thus,  the  correlation  function  of  the  square  of  the  envelope  of  a  stationary  normal 
process  is  equal  to 

,  B,(t)=43Ml+*o(‘)l-  (8.23) 

From  a  comparison  of  (3.23)  and  (7.63),  it  can  be  seen  (as  should  have  been 


t 


expected)  that  the  power  spectrum  of  the  square  of  the  envelope  coincides  with  the 
low-frequency  part  of  the  spectrum  of  a  stationary  normal  random  process  after  its 
square-law  detection. 

In  the  case  under  consideration  an  expression  of  the  correlation  function  may 
be  obtained  directly  from  (8.24),  if  use  is  made  of  formula  (5.16* ).  Differentiating  ; 
©^(vj,  v2)  first  with  respect  to  vlt  and  then  to  v2,  we  obtain  from  (8.24)  j 

»8*  _  4*4  (I  —  Pj*  [1-2/5*  (o.+tr*)  —  4^(1— ffp)  0,-al 


+ 


wherefrom 


<M»l  [I  -  2/:*  (0,  +  0*)  - (1  -  j$ 

[2/«*  +  4*«  (I  -  B?0)  5*1  (</**  +  **  (I  -  R*0)  Oil 
|1-  2«e*  (o,  +  o,)-45«(!  -  R0)  0,0, p 

-.  »•«<! -~/£)  +  8««  =  4o<(I4 -«*„)• 


which  does  not  differ  from  (8.28). 
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5.  Statistical  Criteria  for  Detection  of  Signals  in  Noise. 

A  distinctive  feature  of  the  contemporary  theory  of  electrical  signal  trans¬ 
mission  in  communications,  radar  and  telemechanics  systems,  is  the  fact  that  in  this 
theory  an  evaluation  of  the  influence  of  interference  is  not  restricted  to  such  a 
general  criterion  as  the  signal/noise  ratio  (cf.  Sect.  8,  Ch.VII),  but  employs  the 
finer  statistical  properties  of  the  processes,  which  make  it  possible  to  judge  the 
authenticity  of  the  data  received.  Whereas  for  calculation  of  the  signal/noise  ratio 
it  is  sufficient  to  have  the  power  spectrum  of  the  process  at  the  output  of  the  de¬ 
vice  from  which  the  data  is  being  picked  up,  an  evaluation  of  the  authenticity  of 
received  data  by  ary  statistical  criterion  will  always  require  3  knowledge  of  the 
multidimensional  distribution  functions  of  the  process. 

From  these  statistical  positions  let  us  examine  the  problem  of  the  detection  of 
a  signal  in  noise. 

Let  the  operator  observe,  on  an  indicator,  a  random-process  envelope  which  may 
represent  either  noise  i,ilone,  or  the  sum  of  a  signal  and  noise.  He  does  not  know  in  1 
advance  whether  a  signal  is  present,  and  must  decide  this  question  on  the  basis  of 
observations.  Let  the  observations  be  fixed  at  a  definite  place,  i.e.,  the  problem 
being  solvt'c.  concerns  the  presence  of  a  signal  at  a  given  point.  The  operator  has 
made  the  following  decision:  he  considers  that  the  signal  is  present,  if  the  voltage 


at  the  given  point  exceeds  a  certain  arbitrary  level  uQ,  and  that  it  is  absent  in  the; 


contrary  case.  What  is  the  probability  that  such  a  decision  will  yield  the  correct 
answer? 

It  is  clear  that  an  erroneous  answer  may  be  given  in  two  mutually  exclusive  in¬ 
stances:  1)  when  the  signal  is  absent,  but  the  voltage  exceeds  the  level  uQ  (event  A); 
2)  when  the  signal  is  present,  but  the  sum  o**  the  signal  and  the  noise  does  not  ex¬ 
ceed  the  level  uQ  (event  B ) . 

The  probability  of  event  A,  i.e.,  that  two  events  will  be  combined,  the  absence 


of  a  signal  and  the  exceeding  by  noise  of  the  level  uQ,  is  according  to  the  rule  of  ^ 


multiplication  (cf.  Sect.  3,  equal  to  the  a  priori  probability  of  the  absence  j 
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of  a  signal,  multiplied  by  the  a  posteriori  probability  of  exceeding  the  level  uQ 
under  the  condition  that  a  signal  is  absent. 

The  a  priori  probability  q  we  shall  take  to  be  given,  and  the  a  posteriori 
probability  of  the  noise  exceeding  level  uQ  is  not  difficult  to  obtain  from  the  first 
distribution  function  W^r)  of  the  noise  envelope  [cf.,  e.g.,  (8.3*)] 


{£>  «0J  =  1  -  P  {£<  «„}  ==  I  -  J  w,  (r)  dr  ™ 
00 

=Jw,(r)rfr. 


Then 


P(A)=g 


oc 

Jw  i(r)dr. 


(8.29) 


The  probability  of  event  B  ,  i.e. ,  that  two  events  will  be  combined,  as  the 
presence  of  a  signal  and  the  failure  to  exceed  level  uQ,  is  according  to  the  rule  of 
multiplication  equal  to  the  a  priori  probability  of  the  presence  of  a  signal,  multi¬ 
plied  by  the  a  posteriori  probability  of  the  failure  to  exceed  level  uQ  under  the 
condition  that  a  signal  is  present. 

The  a  priori  probability  of  the  presence  of  a  signal  is  equal  to 

p=l—q, 

and  the  a  posteriori  probability  of  the  failure  to  exceed  level  uQ  is  not  difficult 
to  obtain  from  the  first  distribution  function  of  the  signal-and-noise  envelope  [cf. 
e.g.,  (8.3)] 

»• 

P  {£  <  u0}  =  J  W .  (R,  u)dR. 


Then 


=pjw, 


(/?,  u)dR. 


(8.30) 

Since  events  A  and  B  are  mutually  exclusive,  on  the  basis  of  the  rule  of  ad¬ 
dition  (cf.  Sect.  2,  Ch«  I)  we  find  the  probability  of  an  erroneous  answer 

m 

P[A  or  B)=P(A)  +  P(6)  =  q^wl(r)dr  + 

«• 

+fJwi(R.  u)dR. 
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P(A  or  £)  =  l~(/>  jWi(R,  u)dR  + 

■* 

+  </jjWi  ('’)<*'). 


Consequently  the  desired  probability  of  the  correct  answer  is  equal  to 


PK  «)=1  -P(A  or  £)  =  /?j'w,(/?,  u)dR  + 

*•  "* 

+  <7 1  Wj(r)rfr. 


(8.31) 


The  question,  however,  arises:  what  is  the  best  way  of  selecting  the  arbitrary 


level  u  ?  It  is  clear,  that  if  this  level  is  chosen  sufficiently  high,  the  proba¬ 


bility  P(A)  of  the  false  detection  of  a  signal  will  be  small,  but  the  probability 


P( B )  of  missing  a  true  signal  may  be  considerable.  Conversely,  with  a  sufficiently 


low  level  of  uD  the  probability  of  missing  a  signal  will  be  small,  but  the  proba¬ 


bility  of  false  detection  may  become  considerable. 


It  is  possible  to  formulate  the  problem  of  selecting  the  optimum  magnitude  of 


uQ,  for  which  the  probability  P(uQ,  u)  with  given  distribution  functions  of  signal 
and  noise  is  at  a  maximum.  Computing  from  (8. 31)  the  derivative  —  and  equat¬ 


ing  it  to  zero,  we  obtain  the  equation  for  determining  the  optimum  level 


?v,(«0)=/>W,(«0,  «). 


(8.32) 


When  p  =  q  the  optimum  level  j  s  determined  by  the  point  of  intersection  of  the 


distribution  curve  of  noise  with  the  curve  of  the  joint  distribution  of  signal  and 


noise  (Figure  6l).  As  can  be  seen  from  the  figure,  with  a  strong  signal  the  level 


uD  must  be  chosen  high,  and  with  a  weak  signal  this  level  approaches  the  mean-square 


noise  voltage. 


It  is  not  difficult  to  notice  an  analogy  with  the  problem  cited  in  Sect.  1*,  Ch.  I 


if  the  communication  "yes"  is  made  to  correspond  with  the  signal,  and  the  lighting  of 


the  green  lamp  with  the  exceeding  of  the  voltage  on  the  indicator  of  level  u  . 
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Fig.  6l.  Selection  of  optimum  level  uQ. 


In  t’ne  example  under  consideration  the  observer  is  restricted  to  two  possible 
answers:  "signal  present"  or  "no  signal",  with  the  probability  of  the  correct  answer 
being  determined.  With  the  aid  of  Bayes'  formula  (1.15)  it  is  possible  to  determine 
the  a  posteriori  probability  of  the  presence  of  a  signal,  under  the  condition  that 


the  observed  voltage  exceed  the  level  u  .  A  similar  approach  to  the  problem  of 


signal  detection  in  noise  is  developed  ir.  work  [?]  . 

Formula  (S.31)  Is  extended  to  the  case  where  the  operator  must  decide  the 
question  of  the  presence  or  absence  of  a  signal  on  the  basis  of  K  observations  of  the 
envelope  of  a  random  process.  The  aggregate  of  ”  observations  of  the  random  voltage 
,  £  ....  nay  be  represented  bp- 


cS  S*S/  a  •  i  •->  - » 


"-dimensional  space,  rue  operator 
arbitrarily  divides  this  space  into  two  ranges  3C  and  Z  m  ,  and  considers  that  the 
signal  is  present  if  point  K ( ^ ,  g  ,  ...£jj)  falls  into  range  Gc  and  that  it  is  ab¬ 


sent,  if  the  point  K  falls  into  range  3  . 

Let  w»(r2_,  ^1* •  •  ar‘d  ‘A;( ^ . •  •  •  Tj.  * ' )  “e  «-d~y*enSi0,:a'  rils‘ 

tribution  functions  respectively  of  the  noise  envelope  and  of  the  signal-and-noise 
envelope.  Then  the  probability  of  a  correct  answer  is  determined  according  to  the 


formula 


Pv(Ce.  «)= 

“*!•"  fW*  (A,....*,..  v  —  W  u)dRt...dRK-\- 


^  J *  J (^i» •  •  •  *|. ... 


(3.33) 


In  this  case  it  is  also  possible  to  formulate  the  problem  of  selecting  the 
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optimum  surface  SQ  which  divides  the  space  into  the  ranges  3C  and  G^  so,  that  the 

probability  P„(G  ,  u)  is  at  a  maximum  with  given  distribution  functions  of  signal 
N  c 

and  noise.  The  equation  for  this  surface  is  determined  from  the  relationship 

fW^(2|,  . . .  2^)  —  />W  x  (2|,  u), 

which  for  K  =  1  was  cited  above.  For  two  observations  when  p  =  q  =  \  it  permits 
also  a  geometrical  interpretation .  The  optimum  line  dividing  the  plane  (4^,  into 
two  ranges  is  a  projection  of  the  line  of  intersection  of  the  noise-distribution 
surface  with  the  joint  signal-and-noise  distribution  surface. 

If  the  time  intervals  Z-  between  the  observations  are  sufficiently  great,  then 
the  magnitudes  4^  ,  £^t...  "’ay  be  considered  mutually  independent. 

Then 

W,  (/?,. . . .  Rs,  -H_v  u)  -  W,  (/?,.  «) . . .  W,  {R„.  u) 

(f|, ...  f ^ j,  (/"|) . . .  W|  (^j)- 


In  this  case,  for  a  weak  signal  the  equation  for  the  optimum  surface  SQ  has  the 


form  of 


i.e.,  constitutes  a  hypersphere.  Representing  this  equation  in  the  form  of 

%sss'jf 

i- 1 

we  conclude  that  in  the  event  of  a  weak  signal  the  operator  must  compare  the  mean- 
square  value  of  N  observations  with  the  mean-square  value  of  the  noise.  If  ^  ^  <r Z 
then  on  the  basis  of  N  observations  he  draws  his  conclusion  as  to  the  presence  of  a 
signal. 

If  N  is  sufficiently  great,  then  it  is  possible  to  show  that  the  probability  of 
a  correct  answer  with  p  =  q  =  |  is  in  the  optimum  case  computed  according  to  the 


formula 


(t/ji  a*  \ 

V*  25tJ* 


(8.R4) 


where  F(x)  is  the  Laplace  function. 
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‘:>rmula  (8.34)  makes  it  possible  to  indicate  the  minimum  number  of  measurements 


necessary  to  obtain  a  correct  answer  with  the  required  reliability  for  a  given 


The  dependence  curve  of  function  P,T  on  is  shown  in  Firure  62. 

N  2s* 


*a. 


Fig.  62.  Probability  curve  for  right  answer  in  optimum  case. 


Above  there  has  been  examined  a  statistical  criterion  for  the  detection  of  a 


signal  in  noise,  which  provides  the  maximum  probability  of  a  right  answer  with  one  or 


with  several  observations.  This  criterion  in  called  the  criterion  of  "the  ideal  ob¬ 


server". 


Other  statistical  criteria  are,  however,  also  possible.  For  instance,  in  some 
cases  it  is  important  that  the  probability  P(H)  of  missing  an  existing  signal  dees 


not  exceed  some  constant  K.  In  this  case  with  a  given  number  of  N  observations  it 


is  necessary  to  select  a  criterion  for  which  the  probability  P(A)  of  false  detection 


is  at  a  minimum  under  the  condition  that  P(B)  ^  K  (the  Niemann- Pearson  criterion). 


There  can  be  selected  t  statistical  criterion  of  the  "successive  observer", 


which  with  given  probabilities  of  missing  and  of  false  detection  will  make  it  possible 


to  reduce  the  number  of  observations  N.  According  to  this  criterion  an  K-dimensional 


range  of  possible  signal  and  noise  values  is  broken  up  into  three:  3^,  3C,  and  an 


m 


intermediate  one.  If,  when  n<N,  the  aggregate  of  observed  values  falls  into  th 


intermediate  range,  then  the  following  observation  is  made,  and  so  on  until  this  se¬ 


gregate  falls  either  into  range  G  or  range  G„  ,  after  which  a  decision  is  made  as 

0/  w 


to  the  presence  or  absence  of  a  signal. 


A  comparison  of  the  indicated  three  statistical  criteria  for  the  detection  of  a 


signal  in  noise  is  represented  schematically  in  Figure  63  (in  the  general  case  ranges 
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G^and  Gg  ape  not  one-dimensional).  A  detailed  presentation  of  the  employment  of 
statistical  methods  in  the  problem  of  signal  detection  in  noise  will  be  found  by  the 
reader  in  [ 3]  .  £  6  ]  . 


b) 


«•? 


'  .1 


Fig.  63.  Comparison  of  statistical  criteria  for  detection  of  signal  in 
noise,  a)  ideal  observer;  b)Niemann-Pearson  observer;  c)  successive 

observer. 


6.  One-dimensional  Distribution  Function  of  Phase 


We  pass  to  the  study  of  the  statistical  characteristics  of  the  phase  of  a  normal 
random  process.  In  accordance  with  the  general  formula  (6.30),  the  one-dimensional 
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distribution  function  of  the  phase  of  random  process  (3.1 f )  is  equal  to 


!  *.<«.  0=isr.f™ 


•o  (r  cot  t-n)»  4-  (f  »(it<— o)» 


2»» 


dr. 


Effecting  elementary  transformations,  we  obtain 

f*  —  ir  (u  cot  ♦  t-r  »inj) 


k*  t-r1  oo 


Designating 


1 


re 


2»» 


dr.' 


(3.35) 


i(<) 


«*  (0  +  «*  (t)  =  **  (/).  0,(0  =  arctg  ^ . 

\ 

we  rewrite  (8.35)  in  the  form  of 


1*  30  f*— 2f  1  cot  (0— \ 

*■,(«.  0=2sr«''sr("'" 

0 


?1« 


</r. 

\ 


(8.30 


The  integral  in  (8.36)  is  calculated  by  means  of  a  replacement  of  the  variable  of 
integration 

ir 1  7  - 

*M\“  e  e  I  re 


I'-«  coo  (»*—«•,  >1* 


5»* 


dr  = 


I  (»-*•,>  00 

=  ^re  * 


j  (r -4**  cos  (0—0,)]  e  *’*’  rfr, 

— *  to*  (*—  H4  ) 


wherefrom,  introducing  the  Laplace  function  (cf.  Sect,  7,  Ch.  I),  vre  find 


»|(«.<)=S»  *■  + 


-gr 


(8.37) 


If  the  signal  constitutes  a  harmonic  vibration  with  a  frequency  of  <JQ  and  an 


amplitude  of  uQ,  then  <*  =  u0,  ©4  =■•  0,  and  from  (3.37)  there  follows 

***ln*e 


s  cos  H 

V 2* 

—  *<0^R 


r,(9)=i-e  *  -f-  ■£=■=■•  F  cos  0)  e 


(3.38) 


whereby  s  =  -~  is  represented  the  ratio  of  the  amplitude  of  the  signal  to  the  mean- 
square  Value  of  the  noise.  It  is  obvious,  that  in  a  fixed  moment  of  time  dis¬ 
tribution  (3.37)  has  the  same  form  as  (8.38),  if  only  the  origin  of  the  coordinates 
is  transferred  to  the  point  ©=  0^  and  there  is  designated  s= 

Let  us  examine  distribution  (3.33)  more  closely.  Figure  64, a  shows  a  set  of 


F-TS-~'811/V 


321 


m 


£****»»■ 


phase  distribution  curves,  computed  according  to  formula  (8.38), 


-tt  -iSQ  ~  ffO  -90  -60  -30.  0  3D  60  00  tlO  tSO  »0 
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Fig.  64.  Distribution  function  of  phase  of  normal  random  process: 


a)  probability  density  W^(©), 

b)  integral  function  P(0)(cf.  p.  326  and  further). 


As  can  be  seen  from  (8.38)  and  from  Figure  64, a  the  distribution  function  (©) 


is  even  along©  ,  i.e,,  the  distribution  curve  corresponding  to  it  is  symmetrical 


with  respect  to  the  ordinate  axis.  When  s  =  0 
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vaich  corresponds  to  a  uniform  phase  distribution  for  pure  noise.  With  the  presence 
of  a  signal,  as  s  increases,  the  probability  density  for  0=0  also  increases,  being 
equal  to 

*» 

sf(s)  _  I 


*  +^sr- 


(8.39) 


-JL_  and,  as  s  increases,  tends  toward  zero 


When  0  =  +  -j-  the  probability  density  is  equal  to 

r>(=-r)=Ke  ’  • 


(8.40) 


It  is  easy  to  see,  that 


^(*-e)=rl(0) 


s  cos  8 


Y  2: 


If'  ’  ■(*«*)• 


(8.41) 


i.e.,  that  the  probability  densities  of  two  points,  symmetrically  situated  with  re- 

spect  to  the  +  axis  at  a  distance  of-^-  -  0  ,  differ  by  >co>e  -  2 

“  *  x  y-  e 

When  s<Jl,  i.e.,  with  a  signal  amplitude  much  smaller  than  the  mean-square 


value  of  the  noise  (weak  signal),  from  (8.38),  expanding  the  right  part  into  an 
exponential  series  in  terms  of  s  and  restricting  ourselves  to  terms  of  the  second 
order  of  smallness,  we  obtain 

vp  i  _l£££L!_l!L£2L??,  *<1. 


(3.42) 


7 

In  this  case,  with  an  accuracy  to  quantities  no  greater  than  s  ,  the  point  of 
intersection  of  (©)  with  the  line  W^  =  ^  is  equal  to 

e* == are  cos  =- (t -,%•)• 


(8.43) 


Therefore  when  iei < 0*  wr,(9)>5L  *  and  when  |9|>9*  07,(0),  <2~. 


At  the  boundaries  of  the  interval  (-/?,  Tt)  the  probability  density  is  less  than 


from  (8.42)  it  follows,  that  with  a  very  weak  signal  the  phase  distribution  function 

_L 

constitutes  a  cosinusoid,  displaced  along  the  ordinate  axis  by  the  amount  of  2*  ’ 


with  an  amplitude  of 


2K2* 
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If  ■  s cos 9 > 2,5 ^e  <  —■ ,  s>2,5^,  i.e.,  with  a  signal  amplitude  much 

greater  than  the  mean-square  value  of  the  noise  (strong  signal),  from  (8.38)  we 


obtain 


»»«ln»« 


(8.44) 


When  -j-  (s  >2.5)  it  may  be  considered  that  W^(©)  =  0,  and  for  small 


values  of  Q 


r.W-yfe.-*  • 


(8.45) 


I  0* 

i.e.,  the  distribution  law  for  a  phase  is  normal  with  a  dispersion  of-  7 - jp. 

equal  to  the  noise-signal  ratio  in  the  initial  normal  random  process. 

As  s  increases,  the  phase  probability  density  approaches  the  delta-function  (cf. 


Appendix  IV) 


limr,(0)=M9). 


(8.46) 


which  characterizes  the  distribution  of  the  signal  phase  (assumed  to  be  zero)  in  the 
absence  of  noise. 

We  compute  the  numerical  characteristics  (distribution  moments)  for  function 


(3.33): 


« 

,M=  jW,  (ewe. 


(8.4?) 


For  computing  the  integral  it  is  useful  first  to  represent  W^(Q)  by  a  Fourier 
series  along  0  over  the  interval  (-#,#).  For  this  it  is  sufficient  to  expand  the 
integrand  function  in  (8.35)  into  a  Fourier  series  in  terms  of  0  ,  and  to  make  use 
of  the  well-known  equality  from  the  theory  of  Bessel  functions  (cf. ,  e.g.  G.  N. 
Vatson,  "Tecriya  besselevykh  funktsiy”  (G.  N.  Watson,  A  Treatise  on  the  Theory  of 
Bessel  Functions)  For.  Lit.  Publ.  h’se,,  1?49,  p.  31 ) 


*•"00 

00 

=  h  (**)  +  2  IH  (sz)  cos  «0. 
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(3.43) 


_ _ _ 


*  «**^ 
U 


For  a  strong  signal,  the  phase  dispersion  diminishes  with  the  increase  in 
signal  amplitude,  with 

4-1?.  ••  (3.5*0 

Equality  (3.54)  is  obtained  from  (8.52),  if  use  is  made  of  an  asymptotic  series 
for  the  degenerate  hypergeometric  functions  (cf.  Appendix  VI). 

7.  Errors  in  Measuring  Phase  of  Harmonic  Vibration  due  to  Presence  of  Noise. 

At  the  present  time,  increasingly  widespread  application  in  experimental  en¬ 
gineering  is  being  made  of  the  so-called  phase  method  of  measurements,  linked  with 
the  transformation  of  the  process  under  examination  into  a  process  of  frequency 
change  or  of  alternating-voltage  phase. 

It  is  well  known  that,  in  amplitude  measurements,  instrument  sensitivity  is 
limited  by  fluctuation  noise.  In  phase  measurements,  fluctuation  no5 se  leads  to 
variations  in  the  magnitude  of  the  phase  difference  between  two  signals,  which  is 
being  measured.  In  this  connection  interest  is  afforded  by  the  question  of  errors 
in  phase  measurement,  which  are  caused  by  the  presence  of  noise. 

Let  there  be  measured  the  phase  of  a  high-frequency  harmonic  vibration  with  an 
amplitude  of  uQ  in  the  presence  of  narrow-band,  normal,  stationary  noise.  What  is 
the  probability  that  the  error  in  the  measurement  of  the  fluctuation  phase  does  not 
exceed  some  fixed  magnitude  0  ?  It  is  obvious,  that  this  probability  is  simply  ex¬ 
pressed  in  terms  of  the  integral  distribution  function 

«  * 

p{i,j<0}=  jrt(e)de=2rrl(e)de; 

-4*  5 

where  W ^(0)  is  determined  by  formula  (3.33). 


(3.55) 


Let  us  introduce  the  abbreviated  designation 

•  P{Ifi<9}  =  P(0). 

Substituting  (3.33)  into  (8.55)  we  obtain 

*•  * 


**iln*e 


P(0)=irr  +  ^=Jcos0F(scos0)e  *  d&. 


(8.56) 


(8.57) 
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l.»ij 

II 


***— .  f,  ftluK.  T  «  _  * 


L£r  JSl 


‘-  * +**>. ,  a  •ii.izA  w,  $->v>> 


rs*****n  J^- «-** >wt-  VTT^*— *-  v  -"'■r^ 


The  integral  in  the  right  part  of  (8,57)  is  investigated  in  Appendix  IX.  Em¬ 


ploying  formulas  (9)  and  (12)  obtained  in  this  appendix,  we  find 


P(0)s=f  (S Sin 0)_  JL(j-e)4- 2V(s sin 0,  s cos 0), 


(8.58) 


o<e<-j , 


p(0)=f  (ssin0)-f -~  (©  —  2V  (f sin  0,  —  s  cosO), 


•j-<0<*. 


(8.58* ) 


The  function  V(h,  q)  has  been  tabulated  by  Nicholson  (cf.  Biometrica,  V.  38, 


1943).  These  tables  have  been  employed  to  plot  the  set  of  curves  for  the  integral 


law  of  the  distribution  of  phase  P(0),  which  is  shown  in  Figure  64, b. 


We  note,  that  from  (3,53)  there  directly  follows 


p  (*  _  0)  +  p  (0)  =  2  F  (s  sin  0). 


(8.59) 


From  (3,59)  we  find  when  0  * 


(3.59’) 


If  s  cos  ©  >  3.  then  function  V  permits  the  following  asymptotic  representation: 


2Vrfrsin6,  scos0)  —  F(ssin9)  — 


(8.60) 


Substituting  (3.60)  into  (8.58),  we  obtain  an  asymptotic  formula  for  the  probability 
of  P(0),  which  is  valid  when  s  cos  Q  3» 


p(0)  =  2F(ssin0)  —  1. 


(8.61) 


If  s  «\  (weak  signal),  then,  taking  (3.42)  into  account,  we  find 


'’(«)=* +pssin«+c-sin2a 


(3.62) 


8.  Two-dimensional  Phase-distribution  Function 


In  accordance  with  (6.80),  the  two-dimensional  distribution  function  of  the 


phase  of  the  normal  random  process  (8.1)  is  equal  to 


y,(8„  8,,  t.  0  =  f  J r,r,dr,dr,  X 

•  • 

x  exp — i__  ^(r«  Cos0,  -«,)* 4*Mn©, -«»,)*  +  (8.63) 
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where 


4-  (ra  cos  e2  -  «,)*  +  (r,  sin  02  —  o,)»  - 
-  2R0  ((r, cos  0,  -  a,)  (ra  cos  0»  -  ua)  -f 

-H'i  sin  ©t  —  »i)  {ra  sin  02  —  °a)l}| » 

#,  =  «(/),  «a=tt(/+<).  ®l=°(0.  t»2  =  °(/+t)-. 


(8.63) 

(Cont’d) 


When  u  =  v  =  0,  which  corresponds  to  a  two-dimensional  distribution  of  the 
phases  of  a  stationary  normal  random  process,  there  follows  from  (8.63) 


^(0..©,.  *)= 


4*W 


(i-«5>  II 


W 


r*  +>*— 2ft^,r,co»  (»,—«,) 
2»*  (!—**» 


drxdra. 


(8.64) 


A  computation  of  integral  (3.64),  cited  in  til  ,[  4]  ,  leads  to  the  expression 


where 


,_*[  |>  +  arcslny  1 

®*(©l*  ©J»  t)=s  4x>  [i  —  yi^y  J  * 

—  *<0,<i:,  —it  <02<r, 

y  =  R9  cos(0,  — 02). 


(3.65) 


(8.66) 


When  R0(r)—*C,  y — *0,  and  from  (8.65)  there  follows 

\  ir,(0„  ©I)=^l(0,)^(e2)=~; 

i 

It  is  evid9r.t  from  (8.66)  that  when  ©j_  -  02*  const,  the  distribution  func¬ 
tion  *2(0  *  const,  i.e.,  the  intersections  of  the  probaoilit^  surface 

;?2(©1,  q0,  )  by  the  plane  -  02*  0,  and  by  those  parallel  to  it,  are  straight 
lines,  parallel  to  the  surface  (  ©^©g)  and,  consequently,  the  probability  sur¬ 
face  of  the  phase  of  puce  noise  is  a  ruled  surface*.  Besides  that,  function 
ftg(  ©  ©  2»  t”)  is  evcn  along  ©  1  -  ©  2*  *»e»»  *l>e  plane  0^0  2  Is  I-*-10  plane 

„  As  is  well  known,  a  ruled  surface  is  formed  by  the  movement  of  a  straight  line 
(the  generatrix)  as  it  slides  along  some  curve  (the  directrix).  The  equation  of  the 
directrix  in  the  case  at  hand  is  provided  by  formula  (8,65). 
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of  symmetry  of  the  distribution  surface. 

A  change  in  the  level  of  the  location  of  the  indicated  straight  lines  of  the 
constant  probability  density  is  determined  by  the  intersections  of  surface  W2(0^, 

0  ,  **)  ty  the  set  of  parallel  planes  0.  +  ©  =  const,  which  is  orthogonal  to  the  set 
of  planes  0^  -  =  const.  One  of  these  intersections  (ty  the  plane  0 x  +  0^=0) 

is  shown  in  Figure  6 5.  The  maximum  probability  density,  corresponding  to  &t  =  Qz, 
is  equal  to 

W3max  (T)  =  4Tl  [ 1  +  (t  +  3rC  S'n/?o)  y~T^  '  (8.67) 

From  (8.67),  it  follows  that  max(*0  >  ,  i.e.,  a  correlation  between  the 

phases  increases  the  probability  density  of  ©a  =  ©2,  this  density  increasing  limit- 


M 


■M 


lessly  when  T — *  0  (  R 


1  ).  Furthermore,  if  between  the  correlated  phases 


4 


t|>  ( t  )  and  (f  ( -6  +  v)  there  takes  place  a  constant  displacement,  equal  to  ,  then 

JL  ^ 

from  (8.65)  there  follows  W*(f)  =  ~n~~l  .  i.e-.,  in  this  case  the  probability  density 

2  1  7Z  * 


is  less  than  in  the  absence  of  correlation  by  the  quantity  ^  "f*  When T-X) 
| k0 — *1)  the  probability  density  of  a  displacement  of  Q  tends  toward  zero. 


'4: 


Fig.  65.  Intersection  of  phase-distribution  surface  of  noise 
by  the  plane  0^=  ~  0X. 

1)  B„  *0.9;  2)30=0.7;  3)  Bo  *  0.2;  4)  ^  =  0. 


The  minimum  density,  corresponding  to9^  =  7Z  +  0^  ,  is  equal  to 

K% 


W  4»*  ^ 


=  T~i(  I  —  arc  cos  /?0 


I  l-«i 


U' 


(8.67’) 


From  (8.67*)  it  follows  that  W0  ,  (?)  <  —A— ,  i.e.,  correlation  between  the  phases 

min  ^  7C  ^ 

diminishes  the  probability  density  of  +  7Z,  this  density  tending  toward  zero 

when  V-+  0  (Ro**  1 ) . 
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From  (8,65)  it  is  not  difficult  to  obtain  the  distribution  function  of  the  phase 


difference  <0  (  *  +  X  )  -  (f  (t) 

•-^f  I  5  + 


arcsin  V  I 

®M&)  =  2*  l»  —  _ya  “V"  y  (l  —  >»>*/*  J*  (8.68) 

The  two-dimensional  distribution  function  of  the  phase  of  a  normal  process,  for 


the  case  when  there  is  present  the  signal  u(t)  cosw6t,  has  the  following  form: 


where 


Wi(8hea,x,0=t-^e 


0 


«I+fl2 


x  £  [  ]*  i  r(^3)  x 

m~0  1 

x>r, r)+r(?+0x 

Xlfl(_f.i._4)+1.(i+1)X 

x  i  -4)}. 

«i  —  Vi  Q  u»  -  R<*x  a 

a,-.^F3^cos01’  °2~  oVi-Rl  0” 
ut=u(t),  «,=«(/ +*)• 


(3.69) 


(8.70) 


Formula  (8.6^)  is  sufficiently  cumbersome*.  In  cortain  cases,  it  is  more  convenient 
for  the  analysis  to  employ  a  formula  which  results,  if  the  two-dimensional  phase- 
distribution  function  is  represented  by  a  multiple  Fourier  series  in  terms  of  vari¬ 
ables  and  ©a.  For  this  in  integral  (3.63)  we  assume  v  S  0,  go  over  to  the  vari¬ 
ables  2^  =  ^  and  employ  formula  (3.43).  Then  we  obtain 


**(»!.  e„T,/)= 


»>*<!-/$ 


*1 '*2 

]]*•** 

,"'5'  £',(■ 

f  i 

00 

r —  PftW,  _ 

L*(i-«g)  1 

J'"'  £ 

mm—JQ 

*  A  certain  simplification  of  formula  (8.6?)  may  be  attained  by  employing  relation¬ 
ship  (8)  of  Appendix  VI. 


= y  V*  (JxwfTdx)'= 

_i-*iyTt(n+l+i) 

~~  4s?  H  *!(it  +  f)!  ^0  * 


(8.76)  J 


(Cont*d)J 


Prom  (8.?6)  it  follows  that  the  constant  term  in  (8.75)  is  always  equal  to  -  - 


j  _ *  *5  Cl  r»(>t+  1)  p?« _ I _ fly  n  pin _  I 

•  46*  2j  («!)*  0  ~  4t*  £jr0  1ST  * 


Having  the  series  expansion  (3.72)  of  the  two-dimensional  phase-distribution  .  .1 


function,  it  is  not  difficult  to  compute  also  the  correlation  function  of  the  phase! 

£fW  =  «l,  {*(/)?(*+*)}  =  : 


=  j  J  0|02a’2(01,  0*.  t,  t)dSldQ2= 

— *  — C 

=  £  £  £  -4'~  f  f°.  V'+’*‘'e'l"-*ye1de. 

/— oo»— aon.-jj  — r  — - 


The  variables  in  the  double  integral  are  separable,  and  the  computation  of  each 


integral  is  not  difficult.  As  a  result  we  obtain 


*«-  ns 


r— — oo 


(8.77) 


n=£—r,  m=fir. 


If  there  is  no  signal,  then 


«,('>=«*’£-?■ -W’)- 


and,  employing  (8.76),  we  find  the  expansion  of  the  correlation  function  of  a  static 


ary  normal  random  process  into  a  series  of  powers  of 


!  ££w-V+V^ 


C”= 


/-I  il»U 

I  n2  a 


(3.75) 


=T*(')+-y*S<t)+g«2(t)  +  ... 


9.  Phase  Cosine  Distribution  Functions 


In  some  cases  it  is  necessary  to  have  the  statistical  characteristics  not  of  ta 


phase  (f  (t),  but  of  cos  <j>  (t).  Employing  the  distribution  functions  of  (t)  ob-  | 


tained  in  the  last  chapter,  it  is  not  difficult  to  obtain  the  distribution  functions 


of  cos  (0  (t).  For  this  it  is  sufficient  to  use  the  relationships  which  make  it 


possible  to  find  the  laws  of  distribution  for  functions  of  random  variables  (cf. 
Sect.  1,  Ch.  III). 

We  find  first  the  one-dimensional  distribution  function  of  cos  (j>  (t).  From 
(8.33),  by  means  of  the  replacement  of  the  variable  1  =  cos  0  ,  we  find  the  fol- 
lcwing  expression  l'or  the  one-dimensional  probability  density  of  cos  <j>  (when 
-Tt  <  Q  the  function  O  (2)  =  arc  cos  z  is  two-valued): 


r,(z)=r1(e1(.)]|"<|+r,[e,(.)i  » . 


tfe. 


dz 


<U 


(8.79) 


and  since 


then* 


*b\—  —  1 

dt\  dz  j 


(2)  =  -~=t  2  [i  +V2*szF(sz)e*l 


(3.80) 


Figure  66  shows  a  set  of  the  curves  of  distribution  (8.80)  for  several  values 
of  s.  When  s  =  0  (pure  noise)  the  curve  yields  the  well-known  distribution  of  a 
harmonic  vibration  of  unit  amplitude  and  random  phase  [cf.  (3.16)] 


r,(a)=. 


1 


(8.30') 


• 

When  s  >  0  the  curve  becomes  asymmetrical,  the  probability  density  for  a  given  s 


when  z^>  0  is  greater  than  when  •’•s  linked  to  the  fact  that  the 


probability  density  of  the  phase  when  j©J  <  -j-  is  greater  than  when  J©|  >  —■  ,  i.e., 
that  positive  values  of  cos  Q  are  more  probable  than  negative  ones.  Quantitatively 
this  difference  is  determined  from  the  equality 


V,  (~  z)  =  5Vz)-/4  e~  *  z  >  0. 


(8.81) 
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*  Alt' ough  the  distribution  function  of  the  phase  and  of  the  phase  cosine  are  denoted 
by  the  same  letter  W,  it  is  necessary  in  the  future  to  remember,  that  these  are  dif¬ 
ferent  functions. 


>■■  a***. mug aa^jasgiaaiiift afflfaAwl aa  *, 


Iff  -Cfi  'US  -Qii  0  H2  Qti  QS  no  to1 


Fig.  66.  Distribution  function  of  phase  cosine 
of  a  normal  random  process. 

Employing  expansion  (3.49)  of  the  function  Wj  0  into  a  Fourier  series  and  bearing 
in  mind,  that  cos  k  arc  cos  z  =  T^(z),  where  T^(z)  is  a  k-th-order  Chebyshev  poly¬ 
nomial  of  the  first  kind,  it  is  possible  to  obtain  the  following  expansion  of  V  (z) 
into  a  series  the  Chebyshev  polynomials 


’r'<*>=fTb[^+sSa'r*(4 


(3.82) 


The  coefficients  a^  are  determined  by  formula  (8. 50). 

Let  us  compute  the  distribution  moments  of  cos  (j)  ,  making  use  of  expansions 
(7.17)  and  (7.18)  of  the  powers  of  the  cosine  with  respect  to  cosines  of  multiple 
arcs.  Taking  into  account  the  property  of  orthogonality  of  trigonometric  functions, 
we  obtain  £cf.  (8.49)J 

*»”  I  [i+|v.*]-±[g. +  (8-83) 

=  f  ( E  +  Sa.“8 ' ’*]  *5=5  [S  C ) °*  <2"  ~ 

.-I  (8.84) 

gZ o 

The  first  two  distribution  moments  of  cos<|>  are  equal  to 

m,=M,=j/  2’  “4)=  (3  85) 
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(8.84) 


(8.85) 


-sa^siak  AZil  turn  mAjurv' mu  u , 


.%  =  -r+T,=4+T<f>(l-,'-T)-  (8-86) 

We  find  now  the  probability,  that  cos(j)g  z 

P  (  —  1  <cos? —Fe{z). 

It  is  not  difficult  to  express  this  probability  in  terms  of  the  integral  phase- 

distribution  function  P(0) 

P{  —  l<cos?<2}  =  />{-.*<?<_arccos2}  + 

*{"  P  {arc  cos  a  <  <p  }  =  l  —  P  {^  arc  cos  z  <  <  arc  cos  a}, 

or 

'  Pe  (*)  =  1  — -  P  (arc  cos  z), 

(8.3?) 


From  (8.8?)  it  follows,  that  the  probability  of  1  -  Fc(z)  that  z  ^  cos  < 1 ,  simply 

coincides  with  P(arc  cos  z),  and  for  computing  this  probability  it  is  possible  to 

employ  the  curves  and  formulas  cited  in  Section  7. 

1  The  probability  that  cos  (j)  is  positive  is  equal  to 

■* 

l-Fc(0)  =  Pfy  =  F(s).  (8.88) 

If  there  is  no  signal  (s  SO),  then  P(arc  cos  z)  = — j — -,  and  then  ^compare 

w:tu  (3.17)] 

N  | 

Fc(z)~l  -  —  arc  cos  z. 

To  determine  the  two-dimensional  distribution  function  of  a  phase  cosine  it  is 
possible  to  employ  expression  (3.69)  or  (8.72),  effecting  in  them  the  replacement  of 
variables  z^  =  cos  ©^ ;  =  -os  0^. 

The  inverse  functions  are  two-v,.lued  when  —  *<**,<*,  — 
therefore  to  each  point  of  plane  (z^  z^)  there  correspond  four  points  of  plane 

( ©j.  ex). 

©i^arccos?!,  0,2=  —  arc  cos  a,, 

0?1  =  —  arc  cos  z2,  &.n  =  arc  cos  za. 

✓  x 

^  1  The  moduli  of  the  transformation  jacobians  are,  as  is  not  difficult  to  compute, 
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'"^-•r  jtswtj^vw 


equal  to 


^(aiii^r) 

*(*i.*i> 


_!£(«„,««)  __  rt(Htll«,,)  _  a(«„.eM)  _ 
<*(*,.  *i)  <i(*i.tt)  d(*,.«ar 


(8.89) 


.  .  Vi-z*.Vi-zl 

Let  us  examine  in  greater  detail  the  case  of  the  absence  of  a  signal.  From  ex¬ 


pression  (8.75) .  taking  into  account  (3.39)  we  find 


11  j  (?|,  2j,  t)  — 


P^2  (®ll*  ©Jl.'')^* 


Vi 

+ r2  (9„.  e22l 1) + w2  (0|2,  e21,  x) + w2  (e12,  e22,  x)\ = 

= ytr^v  {«*  +  £  ^ lcos  (r  arc  cos  Zi)  x 

X  cos  (r  arc  cos  z2)  —  sin  (r  arc  cos  *,)  sin  (r  arc  cos  r2)]  + 

09 

+£  Ar  [cos  (r  arc  cos  a,)  cos  (r  arc  cos  z2)  4- 


_r-t 


4- sin  (r  arc  cos  ?,)  sin  (r  arc  cos  z2)]j  = 


w 

^  r^-,  4*  2  Ar  cos  (r  arc  cos  a,)  X 


r-l 


Xcos  (r  arc  cos  z2)| 


and,  introducing  the  Chebyshev  polynomials  Tr(z)  =  cos  (r  arc  cos  z),  we  obtain 


(^| »  ^2>  *)  — 


X 


1*|/  \—ziV\  —  zl 

oo 

*['+*«'$  WWW]. 


(3.%) 


r-t 


1  ^  Zj  ^  1 ,  — ■  l  1, 


where  A  (Y)  is  determined  according  to  formula  (8.7*0. 
r 


Let  us  note  that  series  (8,90)  represents  the  expansion  of  a  two-dimensional 
distribution  function  of  the  phase  cosine  of  a  stationary  normal  random  process  in 
terms  of  orthogonal  Chebyshev  polynomials,  which  fully  corresponds  with  the  general 
method  of  resolution,  indicated  in  Sect.  6,  Ch.  VI,  since  the  one-dimensional  dis¬ 
tribution  function  of  cos  y  ,  equal  to 


— - _ --  over  the  interval  of  -1  ^  z  <  1 

«  V  i  — **  •  N 


coincides  with  the  weighting  function  of  polynomials  Tr(z). 

With  the  aid  of  expansion  (3.90)  it  is  not  difficult  to  find  the  correlation 

/ 

function  for  cos  <j> 
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i 


M 


+  i  -ri 

8(t)=ni|  (cos'f(/)cos?(l+s))=j  f  ,r„i)izliz,= 


where 


In  such  a  manner  [cf.  (8.74)] 


B(t)  =  2kM,(t)  = 


or,  taking  into  account  (8.76),  we  obtain 

'  a  p'2  00 


8 


,  *5W  •>  :Wo(r)  ,  ,  r(2«  —  !)!!  1 

+  8  +“'(»4  ..,«!!  J  iifl  "!•••]• 


(3.91) 


(8.92) 


It  is  also  possible  to  represent  the  expression  for  the  correlation  function  of 
the  phase  cosine  in  another  form.  For  this  the  double  integral  of  (3.91 )  should  be 
expressed  in  terms  of  hypergeometric  functions,  which  in  the  case  at  hand  are  re¬ 
duced  to  full  elliptical  integrals.  Omitting  here  a  presentation  of  the  indicated 


transformations,  we  cite  only  the  final  result 


(8.93) 


where  K  and  E  are  full  elliptical  integrals  of  the  first  and  second  kind,  respectively.  I 
The  correlation  function  of  cos  may  be  computed  without  preliminary  detenni*  | 
nation  of  the  two-dimensional  distribution  function,  which  is  particularly  important  | 
for  the  case  when  a  signal  is  present,  since  in  this  case  determination  of  the  in-  j|| 
dieated  function  leads  to  cumbersome  computations.  It  is  clear  that  (cf.  footnote  111 


on  p.  333) 


+  1  +1 

8  W  =  J  j  *1*2^2  (z,,  Z„  t)  </z,(/z,  = 

*  * 

*  |  j  COS  0,  cos  9tWt  (0,,  e„  T)  rf0,  d9t 


(8.04) 
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■s*.T'V>,'. ,  ^  i 


where  W_(  0  ,  0  ,  S')  is  the  two-dimensional  probability  density  of  the  phase.  Ern- 
2  1  4 

ploying  (8.72)  and  changing  the  order  of  summation  and  integration,  we  find 

•M-fj  jj  s  m‘H>' 

fan— 0^  #l*“— 00  *t  —  — 00  — K  — II 

x  cos  dw.de,. 

In  virtue  of  the  oi  logonality  of  the  trigonometric  functions. 


f  cos  Bje^"  (‘,,ei  </0,  =  /  *'  /,  +  r  =  ^1 

l, 


Ccose^-^e^^  m-r=-i 
J  [9,  tn  —  r^±l. 

Thus,  we  obtain  the  following  general  expression  of  the  correlation  function  of 
cos  (j>  in  the  form  of  the  series 

00 

B(t)  =  *2  J]  4.-r*!.r*.W*  (8.95) 

whose  terms  are  determined  by  formula  (8.71).  If  there  is  no  signal,  then  all  the 
terms,  with  the  exception  of  A1  Q  0  =  .  turn  to  zero  and  (3.95)  turns  into  (3.91), 

10.  Statistical  Characteristics  of  the  Derivatives  of  the  Envelope  and  Phase 

I«t  us  examine  first  the  more  general  problem  of  determining  the  joint  dis¬ 
tribution  of  the  envelope,  the  phase,  and  their  first  derivatives  for  the  random 
process  (3.1),  assuming  that  these  derivatives  exist.  In  order  not  to  encumber  the 
presentation  with  analytical  computations,  we  restrict  ourselves  to  the  case,  when 
the  determined  part  of  the  process  is  a  harmonic  vibration  with  the  constant  ampli¬ 
tude  u  (v  2  0 ) . 

The  starting  point  for  the  solution  of  the  indicated  problem  is  a  four-di¬ 
mensional  distribution  of  the  envelope  and  phase  of  a  normal  random  process 


*«(''!.  ra.  e„  ea,  t) = — -fff.  exp  f - - — _  x 

(2m«)*(| -k‘0)  2j*  (t-/$ 

X  l(r,  cose,-  u)1 4-  r]  sin*0,  -f-  (r,  cos  0a—  uy-  4-  r\  sin*  0a  - 

—  2  Ro !(',  cos0, — u )  (r3  cos  0a—  u)  4-  r,ra sin  0,  sin 0a J ]  J . 


(8.96) 


1 
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i  ! 


<  ) 
,  f 


We  now  effect,  in  distribution  function  (8.°6),  the  replacement  of  variables 


a,  —  Ti  +  r*  «  —r*-rt 

Pi - jf-.  Pa  —  -— . 

*. — *»  +  •»  J.  — ft|— *1 

*  2  *  Va - — • 

The  transformation  jacobian  of  (8.9?)  is  equal  to 

1  L 

2  2 

i-I  0 

*(fi.  _  *  * 


(8.0?) 


<R'V  'v  *|. 


0  1  i 
2  2 


0  0 


I  I 


(8.98) 


Therefore 


•Mft.  h.  fl.  h.  •)= 


'(rf-T*) 


l_ 


(2«-.)-(l-<)CXPi  2--H'-«s)X 


(3.99) 


X  ^[(Pi  +7  Pa)  cos  (6,  +  4,)~u]2+  (p«  +7Pa)*s‘n^i  + 

+  4‘)  +  [(?«  -  7  P»)  cos  (*»  -  TV  “Mf  +  (P'  ~  T  P*)*X 

X  sin3  (*,  - 1  *,)-  2/?0  [{(p,  4- 7  Pi)  cos  (•{.,  4-  7  «,)  ■ -  «  }  X 
X  |(pi  —  7  Pa)  cos  (•;»,  -  7  o2) — «  }  4- 
4-(pt  4-  7  ?*)  (p«  -}  ?*) sin  (ti  +7  ti) sin  (ti  -  7 1*)  ]))  • 

If  in  (8.09)  one  is  to  pass  to  the  limit  when  f — ►(),  then  pt— *■  rjt  — rj, 

ti  ar.d  ta~  rff'  »  ar.d.  in  this  manner  there  will  be  obtained  the  desired 

distribution  of  the  envelope,  the  phase  and  of  their  derivatives  in  coincident  in¬ 
stants  of  time. 

Taking  into  account,  that  Ru{x)~\  4*  7 /?« (0) -^©(t3)  ar.d  taking  the  limit,  we  ob¬ 
tain* 

f*  —  iur  <•<>*  tj  ~  ». 

r4(,.f.e. ~  - 

where  there  is  designated  wJ=~Vr — ft.(0)  (/?”  <  0). 


(8.100) 


If  the  stationaiT'  part  of  the  normal  process  at  the  input  of  a  linear  system  is 

fitr  (0) 

white  noise,  then  it  is  not  difficult  to  express  the  magnitude  .  /?”('))  =  -—  • 
in  terms  of  the  band  of  the  linear  system,  making  use  of  the  appropriate  formulas  for 


*  The  indices  "1"  of  the  variables  are  omitted. 
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the  dispersion  of  the  derivative,  which  are  cited  in  Sect.  3»  Ch*  VI.  It  is  then 

r 

necessary  in  the  indicated  formulas  to  assume  (JQ  =  0,  since  B0(2*)  results  from  BO*') 


when  {J0  =  0.  Then  for  the  ideal  linear  system  »i=*Vr — —  y=j%>  an^  f°r  a 


linear  system  with  a  gaussian  frequency  characteristic  u>t  *s 

From  (8. 100), integrating  along  ©  and  01,  we  determine  the  joint  distribution 


function  of  the  envelope  and  its  derivative  in  coincident  instants  of  time 


Wa(r,  r')~ 

-27.  j'Hu'-r -y  |  r  «  “^TT  _£iLL°i!i 

e  I  “‘/Jje  »,  “ 


d&dQ, 


wherefrom 


-jr.  ("+*•+ '4 


ri  , 


(8.101) 


Comparing  (8. 101)  with  (8.3)  we  find 


(a.ior) 


i.e.,  the  joint  distribution  of  the  envelope  and  its  derivative  is  equal  to  the 
product  of  the  distribution  function  of  the  envelope  (generalized  Rayleigh  function) 
by  the  distribution  function  of  the  derivative,  which  turns  out  to  be  normal  with  a 


2  Z 

zero  mean  and  a  dispersion  of  O'  cJj  , 


Having  the  expression  W2(r,  rf),  it  is  not  difficult,  employin.  (5-105),  to  de¬ 


termine  the  average  number  of  intersections,  in  a  unit  of  time,  of  a  fixed  level 


r  =  rQ  by  the  envelope  of  a  normal  random  process 


*(x#)=2m‘f,W,(r0). 


where  is  the  average  of  the  positive  values  of  a  normally  distributed  deriva¬ 


tive,  equal  to  m[+>=  . 


Therefore 


*(r«>  =  2-^'r'(f o)‘ 


(8.102) 


F-T3-0311/V 


i  ’r-.-t.  x..., ..V_-w - , f-i> -nit  t  1  .  .. Itvii -■•Vi-  iA 


^VJ'.^W,; 


I 


r7S*Tr  W”* <~i*trn^T>~ 

*  \  '**■ 


It  can  be  seen  from  (3.102),  that  the  distribution  curves  of  the  envelope,  which  are 
shown  in  Figure  24,  represent  on  a  certain  scale  also  the  average  number  of  the  over¬ 
shoots  of  the  envelope. 

Let  us  now  determine  the  joint  distribution  function  of  the  phase  and  its  deriva-  ] 
tive,  integrating  (3.100)  with  respect  to  r  and  to  r* .  Integration  with  respect  to 
r*  is  effected  immediately,  yielding 


**«-{ck*  1  "•*  •’  *• 


(3.103) 


Finally,  integrating  with  respect  to  0  ,  we  find  the  distribution  function  of  the 
derivative  of  the  phase  of  a  normal  random  process 


87,(0)= 


**  X 
*  2*1 


(2k*)j/»uj 


a 

— t  0 


r2e 


•  cos» 

•• 


drd  8— 


r»  ,  «'» \ 
«•*  — fSi  f 1  +T) 


(8.104) 


The  integral  in  the  right  part  of  (3.104)  is  cxpi’essed  in  terms  of  a  hypergeometric 
function  (cf.  Appendix  VI).  Then  (©* )  may  be  written  in  the  form  of 

n  ,  /.  ,  ..  x 

"  *'KS  (•♦$)' '  'r  "('♦$)/ 

or,  introducing  the  designations 


87,(0')= 


U  11®^ 

s=—,  »=1 4*— ♦ 

•  “l 

_1L 
2 


we  obtain 


(3.105) 


■M®")—  1^1  (  2  *  *•  2w)‘ 

It  can  be  seen  from  (3.105),  that  function  W^(0' )  is  even  and  the  cur/e  corresponding 

to  it  is  symmetrical  with  respect  to  the  ordinate  axis.  A  set  of  the  curves  of  (©’ ) 
for  several  values  of  s  is  shown  in  Figure  67. 

Fbr  a  stationary  normal  random  process  (u  =  0)  the  distribution  function  of  the 
derivative  of  the  phase  is  equal  to 


(8. 106) 
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V  • :  A. 1  -/awIv  1 J 


Cqa&iiwjfrrf&aa*  -  * 


- 

(  ■; 


r,(e')' 


/  n  *  ki 

'(+“T) 


:r  K2« 


^  : 


(8.108*) 


The  magnitude  Wj  ,  as  has  been  indicat  i  above  (cf.  Sect*  3,  Ch.  VI),  is  pro- 

z  z 

portional  to  the  band  of  the  power  spectrum  of  the  initial  process.  When  6^ 
and  u^ty  the  distribution  of  the  phase  derivative  is  normal  with  a  dispersion  of 

m- 

The  mean  value  of  the  phase  derivative  is,  in  view  of  the  sy  7  of  W^(0’), 
equal  to  zero*.  In  an  attempt  to  compute  the  dispersion  of  the  phase  derivative  we 

CO 

are  blocked  by  the  divergence  of  the  integral  J  0'lfl7,(8')rf(y*  In  fact,  it  can  be 

•*40 

seen  from  (8.106),  for  instance,  that  (0* )  diminishes  when  © — *ao  as  0  and, 

-i-l 

consequently,  the  integrand  function  in  the  indicated  integral  diminishes  as  0  , 

i.e.,  too  slowly  to  ensure  a  convergence  of  the  improper  integral.  Thus,  the  dis¬ 
persion  of  the  phase  derivative  is  unlimited.  Distribution  (8.105)  represents  one 
more  example  (cf.  p.  I33)  of  the  distribution  of  a  random  function,  for  which  a  dis¬ 
persion  does  not  exist. 

As  a  numerical  characteristic  of  the  distribution  of  a  phase  derivative,  there 


may  be  taken  the  average  of  its  absolute  values,  i.e., 


«».  {|  41) = J  |ei  w^»(eo  ^B'=2  f  0*n7l(«orfor.  (8.109)  | 

-«  0  j 

Substituting  in  (8.109)  the  expression  for  W  (0* )  from  (8.104)  and  changing  the  order  | 

VV 


of  integration,  we  obtain 


!= i^ykj  r’‘°  (“"0 «*“ 


or,  expressing  the  hypergeometric  function  in  terms  of  a  Bessel  function  (cf.  Ap¬ 
pendix  VI),  we  find 


*  Cf.  Footnote,  p.  301  •  Consequently,  here  we  ore  speaking  of  the  mean  value  of  th eB 
deviation  of  the  frequen'-.v  from 
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i  ,&d\ t a  >4*  JL&tA 


(8.110) 


m\ 


!l  (2i\ 


If  the  determined  part  of  the  process  is  lacking  (u  =  0),  then 


«|{I?  |}=®i- 


(8.111) 


11.  Correlation  Function  and  Power  Spectrum  of  Process  at  the  Output  of 

an  FM  Discriminator 


To  conclude  the  present  chapter  let  us  find  the  correlation  function  and  power 
spectrum  of  the  phase  derivative  of  a  normal  stationary  random  process. 

This  problem  assumes  still  more  significance  with  the  development  of  frequency- 
modulation  engineering.  As  is  well  known,  a  receiver  designed  for  the  reception  of 
frequency-modulated  oscillations  has,  following  the  amplifier,  two  nonlinear  elements 
a  limiter  and  an  FM  discriminator.  If  the  effective  width  of  the  power  spectrum  of  a 
normal  stationary  random  process  acting  on  the  rf-amplifier  input  is  much  greater 
than  its  pass  bandwidth,  then  the  normal  random  process  £  (t)  at  the  output  of  the 
rf-amplifier  will  be  a  narrow-band  one,  and  may  in  accordance  with  (6.3?)  be  repre¬ 
sented  in  the  form: 


t(t) = A  (/)  cos  +  C  (0  sln  m<f  = 

=  VTFWt  CMO  cos  (v  -  arctSj$) 


If,  besides  that,  the  power  spectrum  of  £  (t)  is  symmetrical  with  respect  to  the 


central  frequency  eoQ  ,  then  A(t)  and  C(t)  are  uncorrelated,  and  their  correlation 


functions  B(?)  are  equal  to  each  other.  To  simplify  the  mathematical  calculations, 
it  may  be  assumed  that,  after  limiting,  the  process  is  equal  to^ 

I,  (/) = cos  [v  -  arcfg  ] . 

Then  the  random  process  at  the  output  of  the  FM  discriminator  coincides  with  the 
phase  derivative  of  a  normal  random  process 

q/a _ i  arctir Cl'*  ~ CQ)-A'V)-A(‘)  C'_0) 

uv)~  4tarCl*A(t)  A*(<) +  £*(*)  •  (8.112) 


*  A  solution  of  the  problem  with  more  general  assumpti  ,  concerning  the  limits 
characteristics  is  cited  in  [l4]  . 
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The  correlation  function  of  random- process  £l  (t)  is  equal  to 

BttW  =  w,{2(0il(/  +  ')}  = 

i  _ fC(<M'(0-/M0C  (/)  C(t+x)A‘  (/+-)-/! (/It) |  .  (8.113) 

‘  l  >1*  (/)  -t-  C*  (f)  '  AHt +-)  +  CHt +-.) 

It  can  be  seen  from  (8. 11 3),  that  in  order  to  determine  (tr),  it  is  necessary 
to  have  an  eight-order  distribution  function  of  the  random  variables  A(t),  A' (t), 

A (t  +  r),  a* (t  +r),  c(t),  c'(t),  c(t  +*),  c*(t  +r). 

In  virtue  of  the  fact  that  the  random  variables  A(t)  and  C(t)  are  uncorrelated 
the  indicated  distribution  function  is  equal  to  the  product  of  two  normal  distri¬ 
bution  functions  of  the  fourth  order,  for  each  of  which  the  defining;  determinant  has 
the  form  of  (5*103)* 

For  subsequent  computations  it  is  convenient  to  employ  an  integral  represent¬ 
ation  of  these  distribution  functions  in  terms  of  the  four-dimensional  characteristic 


functions  corresponding  to  them  (cf.  3*^5* )* 

(*li  ■*!  »  *S'*2  )===. 


•• 

•  00  09  00  -,-v  y  ruvi*t 

Lf  f  f  f.  <-«£. 


(8.114) 


>nn- 

—00  — 00  -09  -00 


2  "do, .  .  .dvit 


^(yuy[,yt.y2)= 


.  ?  ?  *s  *2  ~  rS  i  . 

=(S?I  J  J  ]«  •  ‘ 


-i  O', f-jriu.) 

e  2  du,.. .dut. 


(8.115) 


—«0  00  —00  —00 


where  r^  coincides  with  the  elements  of  determinant  (5.103),  and  O’  =  B(0). 
Taking  into  account  (3.114)  and  (3.115),  we  find 


*•<'>=  Mw* 


•tines 


x~*3  *<(•*, .  •  •  •  ** )  •  •  •>*  )rf*i  •  •  •  dy‘i  — 

i  c  c  y,xi — x,?i  yixi~*iy-2r  1~ i*-i  > 

WJ  —  J  *?+>?  ’  £i+yl 

.  —oo 


(8.116) 


h  tines 

X  e”4  ***  K  ■  ’  dx{...  dvj  dv,...  du4. 


(  .1 


The  integration  with  respect  to  xy  Yj,  ’  and  x?,  x  »,  y  ,  y  * 
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in  (8.116)  is  separable  and  reduces  to  the  computation  of  four  fourfold  integrals  of 


the  sane  type. 

Let  us  examine  the  integral 


M  01  00  OB  # 


K'-W  f  J  J  ta+>ic 


yxx\ 

rr^e  dxxdxldyydyv 


Employing  the  delta-function  (cf.  Appendix  IV),  it  is  possible  to  represent  this 
integral  in  the  form; 

—T»  —am  *  1 

Transformation  should  now  be  made  from  the  variables  x^  and  y^  to  the  polar  co¬ 
ordinates  p  and  . 

x,=pcosf.  y,  =  psin<p; 


K' =  (SO* fj|  dfdf. 


Si51"* 


(4(P,  CO*  *+«,  tin  f)  _ 

:-^)e"Vr^‘ln(TW,df  = 


1  r  1  .  *p  r  4 

«  «»= 

••/i(p»'7-hT)  =a<p/ »;+«!)cost. 


/  * 
*  % 


where 


F-TS-°3ll/V 


K'~k-  1  (u?)J  y»  (p/ofT«T)rfp, 


and  since 


Analogously 


|/,(p/»!+“!)<'p“y=?. 

*=s- ^^‘W- . 


Ki==W  I  ]]]  7[+j[x 

— «0  — 00— 0®  —  9»  ,  1 

x  e-i  ^  ^  dy.x 

=R--^T7*  8^)  5'(“2)- 

I  I  **1 


•o  oo  » 


**-<4 1 J  J  J 

—O*  —  o*  -— 0»  — 00  * 


x  e-<  ^  _ 
■=S-^f5'(I'.)s(‘<,)- 

— «— 00— 00— oo  * 

•  *  3 


(8.11?) 


(8.118) 


(3.11?) 


(8.120) 


Substituting  (8.11?)  -  (8.120)  into  (8,116)  and  taking  into  account  the  filtering 
property  of  the  delta-function  and  of  its  derivative,  we  obtain 

J  •••  j  Tf+^f x 

—  3*  —00 

i  times 

X  -?~-y  l«i8'  (y2) 8  («2) + »i8  (y2) 8'  («2)1  x 

*j  +  «3 

X[«38'K)8("4)  +  ^K)8'(«4)1X 


-•r2  2 '«  (r/p* +"/“*> 
Xe 


</y, . . .  dut  = 
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n  * 

i)  < 


«e  co  oo  oo 


\  c  C  C  f  s»ft** (>‘|0-|  +  «i»a)  +  «*R* (“tt'a ~  viu»)\  y 

“WJ  3  3  3  ■•■ 


—00  —00  —00  —00 


Xe 


(u?+“i>(t3  +  U3> 

_  l!  (rt+«;f  t>*  r“?+  tRw+SRu,",)  .... 

.  *  '  1  1  3 r  3T  dvxdvjduxduz 


Subsequent  computations  of  the  multiple  integral  are  simplified,  if  use  is  made  ■ 
of  the  substitution  of  the  variables  of  integration;  \ 

,  r  '  ( 

P,  =  -C3S(a-f  P),  «,  =  Tsin(a4-p).  ; 

^3  — Tcos?-  tt3  =  4sinP-  1 


Then 


9 

00  00  2 r.  2  « 

fl«  (x>  ”  J j  f  ( W" cos  *  +  R'2  rP s5n2  a)  x 

oooo 


—  -z(r‘  hp’l-IRfp  cos  «) 

Xe  *  d$dzdrdp  = 


00  00  1 

= s]  (  e~  f  r  f,>  (*"  j  cos  ae“*rf  co*  •  da  -f 
oo  5 


2* 


2* 


4-  Rnrp  J  sin*  ae~*,?  co’ '  da)  dr  dp. 


Taking  into  account  that  j^^cos/iae  °  ^  and  employing  formulas  ? 

(3)  and  (7)  of  Appendix  VI,  it  is  not  difficult  to  carry  the  integration  out  to  the  • 


end  and  to  obtain  the  desired  expression  of  the  correlation  function  of  the  random 
process  at  the  output  of  an  FM  discriminator 


Ba  (t)  =4 1 R'*  (*)  -  R"  W  R  Ml  [  1  +  + •  •  •  ]  ■ = 


=  -  T [R12  «  -  *"<’> R (•)!  -}w W~  • 


(8.121 )* 


The  power  spectrum  of  a  random  process  at  the  output  of  an  FM  discriminator  is 
obtained  by  means  of  a  Fourier  transformation  effected  on  B #(?)• 

Let  the  random  process  at  the  input  of  the  rf-amplifier  be  "white  noise",  and 
the  frequency  characteristic  of  the  rf-amplifier  be  a  gaussian  curve.  Then  taking 


*  Since  R(0)  =  1,  then  from  (8.121)  it  follows  that  the  magnitude  (v)  becomes 
unlimited  whenr-*0.  However,  taking  into  account  the  finite  width  of  the  dis¬ 
criminator-filter  pass  band,  the  correlation  function  of  the  process  at  the  output 
of  a  FK  receiver  will  have  a  finite  value  when  r  =  0. 
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Figure  68  shows  the  curve  of  power  spectrum  (8.125). 


i  Wh 


0  1  2  5  4  i 

Fig.  68.  Power  spectrum  of  process  at  output  of  FK  discriminator. 
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PASSAGE  OF  NORMAL  RANDOM  PROCESS  THROUGH  STANDARD  RADIO-EQUIPMENT 

SECTIONS 


1.  Statement  of  the  Question  and  the  Method  of  Solving  it 


It  has  already  been  noted  in  Sect.  1,  Ch.  VI  that  a  characteristic  feature  of 
many  stages  in  the  operation  of  radio  equipment  is  the  transformation  of  electrical 
signals,  which  generally  speaking  are  random  processes,  in  a  standard  section  con¬ 
sisting  of  three  consecutive  elements:  the  input  linear  system,  the  nonlinear  (non- 
inertial)  element,  and  the  output  linear  system.  (Fig.  43). 

If  a  normal  random  process  is  acting  on  the  input  of  a  standard  section,  then 
finding  the  power  spectrum  of  the  process  at  its  output  presents  in  principle  no  dif¬ 
ficulties.  Past  the  input  linear  system  the  process  remains  normal,  and  the  spectrum 


is  deformed  in  accordance  with  the  shape  of  the  frequency  characteristic  cf  this 
linear  system  [cf.  (6.4)].  As  a  result  of  nonlinear  transformation  the  distribution 
functions  of  the  process  cease  to  be  normal,  but  the  spectrum  of  the  transformed 


process  can  still  be  determined  through  the  use  of  one  of  the  methods  set  forth  in 
detail  in  Chapter  VII.  Thereafter  it  is  sufficient  to  take  into  account  the  se¬ 
lective  action  nf  the  output  linear  system,  employing  formula  (6.4). 

However,  in  many  cases  a  knowledge  of  the  power  spectrum  cf  the  process  at  the 
output  of  a  standard  section  is  insufficient,  and  it  is  necessary  to  know  such  finer 
characteristics  of  random  processes  as  the  distribution  functions.  The  determination 
of  distribution  functions  is  tied  in  with  considerable  difficulties,  of  both  a  theo¬ 


retical  and  a  computational  nature,  since  for  this  it  is  necessary  to  solve  the 
problem  of  the  transformation  of  the  distribution  function  of  random  process  in  a 
linear  system  upon  whose  input  there  acts  a  rv ocess  which  is  not  normal  (cf.  Sect.  8, 
Chapter  VI). 

In  those  cases  where  the  process  at  the  input  of  a  standard  section  is  not 


normal,  this  difficulty  appears  already  in  the  first  stage  of  the  investigation.  It 
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may  constitute  an  obstacle  not  only  to  the  solution  of  the  problem  of  determining 
the  distribution  functions,  but  even  to  that  of  the  problem  of  finding  the  power 
spectrum  of  a  process  past  the  nonlinear  element,  since  for  this  it  is  necessary  to 
know  the  second  distribution  function  of  a  random  process  at  the  input  of  the  non¬ 
linear  element  (i.e.,  at  the  output  of  the  preceding  linear  system). 

There  exists  a  limited  number  of  precise  solutions  to  the  problem  of  determin¬ 
ing  the  distribution  function  of  a  process  at  the  output  of  a  standard  section, 
which  have  been  obtained  with  some  special  assumptions  as  to  the  nonlinearity  charac¬ 
teristic  and  the  statistical  properties  of  the  random  process  at  the  input. 

An  approximate  method  of  determining  the  one-dimensional  distribution  function 
consists  in  computing  a. certain  number  of  distribution  moments.  This  method  permits 
generalization  £4]  ,  but  even  in  its  simplest  form,  as  it  was  set  forth  in  Sect,  8, 
Chapter  VI,  its  practical  application  is  tied  in  with  cumbersome  calculations. 

In  the  present  chapter  there  is  examined  a  precise  solution  to  the  problem  of 
determining  the  one-dimensional  distribution  function  of  a  process  at  the  output  of 
a  standard  section,  with  two  fundamental  restrictions; 

1)  the  random  process  at  the  input  constitutes  the  sum  of  a  determined  signal 
S(t)  and  a  stationary  normal  random  process  with  a  uniform  spectrum  ("white  noise"), 
and  with  an  intensity  (average  power  per  unit  of  band)  equal  to  <r*; 

2)  the  characteristic  of  the  non-linear  element  is  quadratic;  y  =  x^  (the  con¬ 
stant  multiplier  is  omitted).* 

The  problem  under  consideration  obviously  coincides  with  the  following  problem, 
of  important  significance  in  many  radio-engineering  applications  (location,  com¬ 
munications,  etc.). 

The  input  of  an  rf-amplifier  is  acted  upon  by  a  determined  signal  S(t)  and  by 
fluctuation  noises.  The  signal  is  subjected  with  the  noises  to  square-law  detectors 


*  A  solution  of  the  problem  for  more  general  assumptions,  where  the  multiplier 
serves  as  the  nonlinear  element,  is  cited  in  17J  • 
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and  to  the  subsequent  filtration.  What  is  the  distribution  function  of  the  signal 

and  the  noises  at  the  output  of  the  filter?  J 

} 

In  the  following  exposition,  the  terminology  connected  with  this  special  problem  ] 
is  preserved  for  the  sake  of  greater  definiteness.  Two  cases  are  considered:  a)  a  1 
wide-band  rf-amplifier  and  b)  a  narrow-band  rf-amplifier  (the  width  of  the  frequency-  \ 
characteristic  band  is  much  less  than  the  central  frequency).  In  the  first  case  the  \ 
process  after  nonlinear  transformation  is  assumed  equal  to  the  square  of  the  random  j 
process  at  the  output  of  the  rf-amplifier.  In  the  second  case  the  process  after  non-  ’ 
linear  transformation  is  assumed  equal  to  the  square  of  the  envelope  of  the  random  j 
process  at  the  output  of  the  rf-amplifier  (i.e.,  the  high-frequency  component  of  the 
process  is  discarded } . 

Vfe  shall- show  that  the  processes  at  the  input  and  output  of  the  standard  section  \ 
in  question  are  linked  by  an  integral  relationship.  Let  the  linear  systems  of  the  ; 
standard  section  be  characterized  by  their  pulse  transfer  functions:  the  rf-amolifiert 


by  the  function  (z)  and  the  filter  by  the  function  h^fr).  The  link  between  the 


pulse  transfer  function  and  the  square  of  the  frequency  characteristic  of  a  linear  l 

j 

system  is  provided  by  the  formulas  in  Sect*  2,  Ch.  VI).  A 

Let  us  designate  white  normal  noise  by  £  (t).  Since  the  signal  and  the  noise 

pass  through  a  linear  system  independently,  the  process  at  the  output  of  the  rf-  , 


amplifier  will  be  a  sum  of  two  items;  the  determined  S^(t).  and  the  stationary  normal  i 


random  process  £j(t),  each  of  which  may  be  represented  by  Duhamel’s  integral  (cf.  - 

6.3)  •  .  i 

5,(0=  J  ht{z)S(l  —  \)dx. 


m 

MO—  j*  A,(t)s(/ — t)rft. 


(9.1) 

(9.2) 


From  (9.1)  and  (9.2)  there  follows  the  possibility  of  representing  the  square 
of  the  random  process  at  the  output  of  the  rf-amplifier  in  the  form  of 
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m  « 

.  PiPHMOl*— J  Jm«)  !•$('— «)-k (/-«)] a,  (w)[S(/~t»)f  (9.3) 

-H(/  —  v)\dudv. 

If  £  (t)  is  the  process  after  filtration  (i.e.,  at  the  output  of  the  standard 


section),  then 


6,(0=  j  h2 (t) [S, (/  —  t)  $, (f — t)J* dx. 


(9.4) 


or,  substituting  into  (9.4)  the  expression  (9.3)  and  replacing  the  variables  of  in¬ 


tegration  u  and  v  by  u-  Z  and  v  -  ?,  we  obtain 


00  m 

M0=  J  j  K(«.»)(S(/-«)  4-  —  (S(/-0)-f- 


where 


+  «(/  —  v)\dudo. 


K[u,v) — .  J  hx(u — t)A2(t)A,(o  —  t) dr. 


(9.5) 


(9.6) 


Expression  (9.5)  represents  the  desired  integral  transformation,  by  which  the 
process  at  the  output  o*  the  standard  section  is  linked  to  the  process  at  its  input. 
We  shall  call  the  function  K(u,v),  which  depends  only  on  the  characteristics  of  the 
rf -amplifier  and  the  filter,  the  nucleus  of  this  transformation*. 

In  problems  dealing  with  the  envelope  of  the  process  at  the  output  of  a  standard 
section,  there  is  placed  under  the  sign  of  integral  (°.h)  not  the  square  of  the 
random  process  at  the  output  of  the  rf-amplifier,  but  the  square  of  its  envelope. 

Here  it  is  useful  to  employ  the  concept  of  the  narrow-band  normal  random  process  in 
the  form  of  a  sum  [cf.  ( 5 . 39 )J 

,  *1  (0  4*  (0 = IS*  (0 + SA  (01 cos  wo*  + 

+  fc(0-W0lsin«*  CS>,7) 


Ihus  the  solution  of  the  problem  at  hand  has  been  reduped  to  a  determination  of 
the  statistical  characteristics  of  integral  (9  5),  for  which  there  will  be  necessary 
a  more  detailed  study  of  the  properties  of  such  integral  transformations. 


*  In  taking  into  account  the  physical  feasibility  of  the  rf-amplifier  and  the  filter, 
it  should  be  assumed  that  h^(t)  =  0,  h^(t)  =  0  when  t  <  0. 
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Since  consideration  has  been  given  above  to  the  nonlinear  transformations  only 
of  the  envelope  of  a  narrow-band  normal  random  process  (Sec.  Chapter  VTII)and  not  to 
the  nonlinear  transformations  of  wide-band  normal  random  processes,  therefore  #2, 
which  contains  a  detailed  computation  of  the  first  two  distribution  functions  of  the 
square  of  a  wide-band  normal  random  process,  is  prerequisite  to  a  solution  of  the 
principal  problem  to  which  the  present  chapter  is  devoted.  In  a  certain  measure  this 
section  may  serve  as  a  standard  example  in  the  determination  cf  the  distribution 
functions  of  random  processes  undergoing  nonlinear  transformations. 

2.  Distribution  Functions  of  the  Square  of  a  Normal  Random  Process 

bet  us  find  the  two-dimensional  distribution  function  of  the  square  of  a  normal 
random  procesr.,  having  employed  the  general  formulas  for  the  replacement  of  vari¬ 
ables  in  distribution  functions  undergoing  transformation  (cf*  Sect.  1,  Ch.  Ill)* 


where 


Hi  —  ^  ,  Hj  —  fcj  ♦ 

5, =*(/).  t*=5(/+x). 


We  designate  by  w2(x.j,  x?,  r,  t)  and  y2,  r,  t)  the  two-dimensional  dis 

tribution  functions  of  a  normal  random  process  and,  respectively,  of  its  square. 

2 

Since  the  function  inverse  to  y  =  f(x)  =  x  is  two-valued,  to  each  point  with  the 
coordinates  y^  >  0,  y^  >  0  there  will  correspond  four  points  in  plane  (x^,  x2): 


*n = Vy_^ 

*n  =  Vy»  y* 


(9.8)' 


Then  in  accordance  with  (3 .7) 

Va(yt,yt,  t,  t)=w2(xu,  x2lt  t,  1+ 

+  “’*(■*11.  *n>  0 | + *«•  *•  *) |  Tvtxfi  |  (9.9) 

+ •«  (*» *» x>  Q  |  |  • 

Tne  absolute  values  of  all  four  jacobians  in  (1.9)  do  not  differ  from  each  other  and 


are  equal  to  — ?==. . 
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Substituting  the  expression  (?.l)  of  the  two-dimensional  function  of  a  normal 
random  process  into  (9.9)  and  taking  into  account  (9.3),  we  find 

*•  •"  “sin:5ii_x 

(«ti— ftti)  *ryi-Ha»—  »g|)  yr7>+R'/7rt, 

Xt  1,1  (l  ~  Rt)  + 

<«i —Ha,)  Yy[—  (a»— Oail^yT— 

+  e  + 

_  <*i— *°i>  *^+(0;— »g|)/yl— K^yiyi 

+e  + 

_  (fl|-»a,)  <a.~ pai)*9>i  \ 

+  e“  J= 

.i+aj-Wa.a, 


iVyjx  *2*3*  yi -k* 


e  *•*  (1  -  R’) 


c {e-*^  ch[  («.-^)^+(;*-^)^>*- ]  + 

_l_e_  «»(i—  ipjgjj  ^(gi  —  Vy\  ~  (g*  ~  ^ai)  J 


Transforming  the  hyperbolic  cosines  cf  the  sum  and  difference  and  grouping  the  terms 
with  cosines  and  sines,  we  find  the  desired  expression  for  the  two-dimensional  dis¬ 
tribution  function  of  the  square  of  a  normal  random  process: 

2Ra, a,  y>+y< 

II 7/..  ..  .a _ * _ »“  *"»-*■>  V/ 


y*.  *.  0  -  2*;*7i^1»r  x 

x{ch[^)lch[%E^l]ch[^^|?.]+  (9_10) 

+ -h  [5^]  ^  [  ^■<(?-^),)  M  ]}  ■ 

*>0.  y*>° 

If  the  determined  part  is  missing  (a^  =  *2=0),  then  from  (9.10)  we  obtain  the  two- 
dimensional  distribution  function  of  the  square  of  a  stationary  normal  random  process 


Vj(yi. y*.  «)— S*1,"*,>ch [^V-*)] * 

y.>o,  y*>o. 


(9.11) 


It  is  not  difficult  to  obtain  a  one-dimensional  distribution  function  from  (9.10), 
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(R-*0);  then 


v< M = Tibr  e~  ^ch  • »>°- 


(9.12) 


When  a  =  0,  we  obtain  the  probability  density  of  the  square  of  a  random  variable  dis¬ 


tributed  according  to  the  normal  law 


y>°- 


(9.13) 


which  does  not  differ  from  (3- 1^) - 


If  a^o*!  then  in  (9.12)  the  hyperbolic  cosine  may  be  replaced  by  its  asympto¬ 


tic  approximation 


Then  distribution  function  (9.12)  may  be  rewritten  in  the  form  of 


(VT-m? 


(9.1*-) 


Figure  69  shows  the  curves  of  distribution  function  (9.12)  for  several  fixed 
values  of~.  Curve  1  corresponds  to  (?.13)»  i.e.»  to  a  purely  random  process. 


i  2  1  Tt  «  a  n  * 

Fig.  69.  Distribution  function  of  a  square  of  normal  random  process. 

The  expressions  (9.10)  and  (9.12)  obtained  above  represent  the  distribution 
functions  of  the  square  of  a  normal  random  process  in  the  most  general  fora,  when  no 
supplementary  assumptions  are  made,  with  respect  to  the  shape  of  its  power  spectrum. 
For  the  problem  under  consideration  in  this  chapter,  this  is  equivalent  to  the  absence 
of  any  special  restrictions  with  respect  to  the  shape  and  central  frequency  of  the 
frequency  characteristic  of  the  input  linear  system  of  the  standard  section.  If, 
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however,  this  linear  system  is  3uch  that  its  linear  characteristic  is  symmetrical 
with  respect  to  the  central  frequency  ,  and  its  band  width  is  A  «CJQt  then  the 
normal  random  process  at  the  output  of  such  a  system  will  be  a  narrow-band  one.  Then 
its  square  will  consist  of  two  terms:  a  low-frequency  one,  coinciding  with  the 
square  E'(t)  of  the  envelope  of  a  normal  process,  and  a  high-frequency  one,  equal  to 
E~(t)  cos  2  [c*J0*  -  tf«)  ]  .  The  distribution  function  of  E'(t)  were  determined  in 
Sect.  U,  Ch.S  [cf.  (3. IS)  and  (3.20)J  .  The  distribution  of  the  high-frequency  com¬ 
ponent  may  be  obtained  from  a  consideration  of  the  product  E2(t)  cos  2[q> 

The  low-frequency  tern  of  the  square  of  the  envelope  of  a  stationary  normal  random 
process,  E2^),  is  distributed  according  to  the  exponential  law,  with  the  phases 
equiprobable.  rfoploying  (3.25)  and  taking  into  account  (2.20*)  and  (5.80’),  we  find 
the  one-dimensionai  distribution  funct'on  W.9(y)  cf  the  high-frequency  term 


(9.15) 


•  -  &»»* 


where  KQ(z)  is  the  Eessel  function  of  an  imaginary  argument  of  the  second  kind  and 
of  a  v.ero  order  (cf.  0.  N.  Vatson  (Watson),  Teoriya  besselevykh  funktsiy  (A  Treatise 
on  the  Theory  of  Bessel  Functions).  Foreign  Literature  Pub.  Hse.,  19^9,  p.  2C0). 

A  curve  of  the  function  W  (  )  is  shown  in  Figure  70. 


*01 ' 


•j  -i  -i  o 


1  2  2  ^ 


Fig.  70.  Distribution  function  of  the  high-frequency  term  of 
the  square  of  a  normal  random  process. 

3.  One  Result  from  the  Theory  of  Integral  Forms 


Let  us  now  return  to  the  study  of  integral  transformation  (9.5);  for  this  it 
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will  be  necessary  to  draw  upon  one  result  from  the  theory  of  integral  forms.  Omit¬ 
ting  here  the  proof  of  this  result  which  is  referred  to  one  of  the  handbooks  on 
integral  equations  (cf.  e.g.,  I.  0.  Petrovskiy,  Lektsii  po  teorii  integral* nykh 
uravneniy  (Lectures  on  the  theory  of  integral  equations),  C-ostekhizdat,  19^3),  we 
shall  restrict  ourselves  here  to  several  geometrical  analogies. 

Let  us  consider  the  continuous  function  y  =  f(x),  in  the  interval  (a,b).  For 
a  full  determination  of  this  function  it  is  necessary  to  assign  to  it  values  at  every 
point  in  the  indicated  interval.  However,  some  concept  of  this  function  is  provided 
by  its  values  at  n  points  x1 ,  x 2,  ...x^.  Let  us  adopt  the  designation  y-  =  f(xt-) 

(  i  =  1,  2,...n).  .  The  numbers  y1 ,  y?,  . .  .yn  may  be  regarded  as  the  components,  in 
an  n-dimensional  space,  of  a  vector  drawn  from  the  origin  of  the  coordinates.  Thus 
to  the  function  f(x)  there  corresponds  the  vector  (y1 ,  y^,  .  ••}’„)•  The  greater  is  n, 
the  more  precisely  is  the  function  approximated  by  this  vector.  The  length  (or  the 
"norm")  of  this  vector  is  equal  to  ■  W*  ~\~y\  +••••>£.  Taking  the  limit  when 
n-*«o,  it^is  natural  to  call  the  "length"  ("norm")  of  the  function  f(x)  the  magni¬ 
tude  ✓I  n*)dx. 

The  function  is  called  normalized,  if  its  norm  is  equal  to 

•  1.  The  scalar  product  of  the  two  vectors  (y[\  y^\  ...y^)  and  (y  ,  y^\  .  ..y^) 

n  >2  n  i  2  n 

is  provided  by  the  formula  VV’yfY  analogously,  we  shall  call  the  scalar' product  of 

.  M  * 

the  two  functions  f^(x)  and  f the  integral  \f\[x)f2{x)dx.  Twc  vectors  are 

a 

orthogonal,  if  their  scalar  product  is  equal  to  zero.  The  condition  for  the  ortho¬ 
gonality  of  the  functions  is  written  in  the  form  of 


|/,(x)f,(x)dx=0. 


The  equation  for  a  2-nd  order  surface  in  an  n-dimensional  space  is  put  quad- 


ratically  and  has  the  form 


n  n 

5]Ev<y/=const’ 


i-i /-i 


with  =  k^.  The  corresponding  analogue  in  the  space  of  the  functions  is  the 
integral  form 

»  » 

1 1  K(u,v)f  («)  f  (v)  dudv = const, 

•  m 
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where  the  nucleus  K(u,v)  is  symmetrical,  i.e.,  K(u,v)  =  K(v,u). 

It  is  well  known  that  the  equation  for  a  second-order  surface 

m  m 

4-1  i-l 

may  be  reduced  to  the  canonical  form: 

m  ] 

=  const  ( m<n ), 

i-t 

if  the  transformation  is  made  to  such  a  system  of  coordinates,  in  which  the  principal 
axes  of  the  surface  serve  as  the  coordinate  axes.  This  reduction  to  the  canonical 

form  is  effected  by  the  linear  transformation 

* 

z4~  J 

i-i 

the  vectors  (a^,  a^2.  .  ..a^)  forming  an  aggregate  (i  =  1,  2,  ...n)  of  orthogonal, 
normalized  vectors,  directed  along  the  principal  semiaxes  of  the  surface  under  con¬ 
sideration.  To  the  true  semiaxes  there  correspond  A  ;>0.  If  n  <■  n,  the  surface 
degenerates  into  a  cylindrical  one.  It  is  proved  that  the  coefficients  a^.  of  the 
transformation  satisfy  the  system  of  linear  homogeneous  equations 


Completely  analogously,  an  integral  form  with  a  symmetrical  nucleus  may  be 
represented  in  the  form  of  the  finite  or  infinite  summation* 


where 


jj K(«,  v) f  ( u ) f{v}dudv=:^^-  , 
<»“  f-i  1 

—  J  f(x)^(x)dx. 


(9.16) 


(9.17)' 


and  the  functions  (^.(x),  (i  =  1.  2.  ...)  are  an  aggregate  of  orthogonal,  normalized 
functions,  each  of  which  satisfies  the  ioraogeneous  integral  equations 


t<(jc)=x4jK(x,y)?J(y)rfy. 

*  i= 1,2,... 


(9.17*) 


*  When  the  upper  limit  of  a  summation  may  be  finite  or  infinite,  only  its  lower 
limit  is  indicated. 
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’/t 


The  solutions  for  (x)  are  called  proper  orthogonal  functions,  and  the  numbers^-, 
the  proper  values  of  integral  equation  (9.1?').  If  a  large  number  of  the  proper 
functions  is  finite,  the  nucleus  of  the  integral  equation  is  called  a  degenerate  one. 

Formula  (9.16),  and  (9.1?)  and  (9.1?')  which  are  linked  to  it,  represent  that 
result  from  the  theory  of  integral  forms  which  is  employed  for  studying  the  dis¬ 
tribution  function  of  the  random  process  at  the  output  of  a  filter. 

This  formula  also  follows  from  the  possibility  of  expanding  the  symmetrical 
nucleus  K(u,v)  into  the  series 


KC,o)=V^ 

T-\ 


(9.18) 


Let  us  note  that  the  expansions  (?.5)»  (8.10)  and  (8.25)  of  symmetrical  two-di¬ 
mensional  probability  densities  are  expansions  of  the  type  of  (9.18). 

4.  Characteristic  Function  of  Random  Process  at  Output  of  Filter 

.•In  Section  -1  11? -was  .shown  that  the  random  process  at  the  output  of  a  filter  is  : 
represented  by  the  integral  form 

\  5,(0=  J  ]K(u,v)[S[t-u)+l(t-u)){S(t-v)  + 

+  5(<— v)]dudo, 

the  nucleus  K(u,v)  of  which,  as  is  not  difficult  to  see  from  (9.6),  is  symmetrical. 
Then,  employing  (?.16),  we  represent  the  preceding  expression  in  the  form  of  the  sum¬ 
mation 

k—filW+niWP 


i-i  • 1 

where,  in  accordance  with  (9.17)  and  (9.17’ )* 

5,(0=  j  S(t~x)f{(x)dx, 

— O* 

M0=  xM*)dx’ 


(9.19) 


(9.20) 


(9.21) 


and  (j^(x)  and  are  the  proper  orthogonal  functions  and  the  proper  values  of  the 
homogeneous  integral  functions. 
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i  > 


(9.22) 


?M=*  J  K(x,y)<f(y)dy. 

-«• 

The  nucleus  of  integral  equation  (9.22)  is  expressed  in  terms  of  the  pulse  tranfer 
functions  of  the  rf-amplifier  and  filter  according  to  formula  (9.6). 

Equation  (9.22)  may  be  reduced  to  a  different  equation,  the  nucleus  of  which  is 
the  product  of  the  correlation  coefficient  of  the  noise  at  the  output  of  the  rf- 
amplifier  and  the  pulse  transfer  function  of  the  video  filter.  For  this  we  substi¬ 
tute  (9.6)  into  (9.22)  and  change  the  order  of  integration 

t(*)=i  J/r,  (i)  h{  (x  - 1)  J  h{  (y  —  t)  f  (y)  dydx. 


Having  multiplied  both  parts  of  the  last  equality  by  h^(x  -  z)  and  integrating  with 


respect  to  x,  we  obtain 


/  (z) = A  J  Aj  <t)  /  (t)  J  At  (x — t)  A,  {x  —  z)  dxdx, 


where  there  is  designated  f{z):=^'t(x)hl(x—z)dx.  But  according  to  (6.13*)  the 
correlation  coefficient  of  white  noise  at  the  output  of  an  rf-amplifier  is  equal  to 


^  W  ~  J  (u)  h\  (« -f  x)  du. 

— 00 

Consequently,  f(z)  satisfies  the  integral  equation 

f(z)  = A  J  R(z-~ t)ka[x)f{t)dt. 


(9.22* ) 


The  problem  of  the  study  of  the  statistical  characteristics  of  the  random  process 


£  (t)  is  now  reduced  to  a  determination  of  the  distribution  functions  of  the  sum  of 


the  squares  of  random  processes  S^(t)  +  ij^(t),  in  which  S^(t)  are  determined,  and 
lj^(t)  are  random.  Since  we  are  restricted  to  the  determination  only  of  a  one-di¬ 
mensional  distribution  function,  it  is  sufficient  to  carry  out  all  further  investi¬ 
gation  in  an  arbitrary,  but  fixed  moment  of  time  t.  We  shall  show  that  the  random 
variables  and  7  i"  whenK^j  are  uncorrelated.  This  makes  it  possible  for 


us  merely  to  define  the  joint  determination  of  7^(t),  7^(t),  ...  J^'t)  as  the 


product  of  their  one-dimensional  distribution  functions. 
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i  I 


I  l 


\ 


i j  I 


Let  us  then  examine  the  mean  value  of  the  product 


«i  {i*  (0  *i  (0} = ■ «i  { ] 1  (<  -  *>  ?*  (*) dx  J &  (<  -  y >  *<0W = 
••«  — « 

=  J  j  9k  (x)  ft(y)m{  {5  (/-x)5(*-  y)}  dxdy. 


Bearing 


inp’  in  mind  that  the  correlation  function  of  white  noise  is  equal  [cf.  (5-34)] 


and  taking  into  account  the  filtering  property  of  tr.e  delta- function  (cf.  Appendix 


IV),  we  find 


m, {ti*(/)ti/(/)}=a* J  J f k(x)?,{y)Hx-y)dxdy=: 


=3*  J  9t(x)?j(x)dx. 


But  the  functions  .(x)  are  mutually  orthogonal,  therefore 


(9.23) 


Q.E.D. 


Since  it  is  a  condition  of  the  problem  that  the  white  noise  £ (t)  at  the  out¬ 
put  of  the  rf-amplifier  has  a  normal  distribution,  the  distributions  of  (t),  rep- 


resented  by  integrals  of  ^  (t),  will  also  be  normal.  Then  in  virtue  oi  (9.23)  their 
joint  distribution  will  be  equal  to  the  product 


_  'i 

V{yt,  y„...y(l,..)=np^|e 


(9.24) 


Having  the  product  (9.24),  it  is  now  not  difficult  to  obtain  the  expression  for 
the  desired  one-dimensional  distribution  function  of  the  random  process  £z(t)  at  th 
output  of  the  filter.  For  this  there  should  first  be  determined  the  characteristic 
function  0^(v,t)  of  summation  (9*19).  Employing  formulas  (3*23)  an<l  (3*7^) »  we  fin 


r Vf/W+r/P 

f  .f  1  *' 


(9.25) 


‘  .'rUtjr—  ■ rfclv  I'l&’tA,*' eatsi. 
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cj  oo  Jl.isnjSjyj-trj) 

Xdy,(/yt...dym..  .=  J  ...j  f|[e  '  X 


—00  —00  / 


I  rv. 


xF^e 


<ty}= 


(9.25) 

(cont’d) 


'**/  .  .  .  .  VS,9 

.  n  I  -V  r  -  . 


/  r  ' 

e  r 


Completing  the  square  of  the  exponent  under  the  integral  and  integrating  (cf.  Sect*  8, 


Chapter  Hi),  we  obtain  after  simple  algebraic  transformations 


e,(M)=n 


*f  Mo«» 
Sr^-iuo.* 


(9.26) 


For  the  case  of  a  narrow-band  process,  the  expression  for  the  envelope  E  (t)  at 
the  output  of  the  filter  is,  in  accordance  with  (9.?),  obtained  from  (9.19)  by  the 
replacement  of  [$  (t)  +  ^  (/)]2  by  the  sum  of  squares 


where 


E,(t)  =  J]  ^  {{SAl  (0  +  (01*  +  lSc,  (0  +  (0]*}. 

i 

S„(f)=  JS,(l-*)t,W.  d*.  Sc,=  ]scV~x)?l(x)dx, 

—CO 

lA{t-x)9l{x)dx,  J  V:(<-«)t, (*)*<*. 


(9.27) 


(9.28) 


(9.29) 


Then  the  one-dimensional  characteristic  function  of  this  envelope  is  obtained  analo¬ 


gously  to  (9.25) 


e,<».o=  J...  ]«p[*»Et7 |(s„ + *,)•+ (sc) +y,)>]| x 


X II { snre”  dx/ty,]= 


(9.3°) 


—00  —oo 


={  i- j 


x(J  \]}- 

-«•-»  /  / 
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Each  of  the  multiple  integrals  in  the  curved  brackets  coincides  with  (9.25)*  if 
only  Sj  is  replaced  by  S^.  or  respectively  by  Sq^.  Therefore,  taking  into  account 
(9.26),  we  find 


SAi+SCI  Moa* 


e,(o.0=n-w*  v~. 


(9.31 ) 


I  *"*  K 


The  desired  one-dimensional  distribution  function  of  the  random  process  (or 
envelope)  at  the  output  of  a  filter  is  obtained  from  (9.26)  or  respectively  from 
(9.31)  by  an  inverse  Fourier  transformation. 

In  principle,  the  problem  before  us  appears  to  be  solved.  However,  in  formulas 
(9.26)  and  (9.31)  there  figure  the  characteristic  numbers  X  •  ,  for  the  determination 

J 

of  which  it  is  still  necessary  to  solve  the  integral  equation  (9.22)  or  (9.22* ). 

Only  in  one  special  case  does  the  solution  of  this  integral  equation  turn  out  to  be 
extremely  simple.  This  is  the  case  of  an  output  filter  whose  frequency  character¬ 
istic  is  uniform  at  all  frequencies.  In  this  case  h2 (2O  -$(?),  and  from  (9.6), 


taking  into  account  the  filtering  property  of  the  delta-function,  ve  find 

K{u,v)=hl{u)hl(v). 


(9.32) 


Comparing  (9.32)  with  (9.18),  we  become  convinced  that  the  nucleus  is  degenerate, 
since  there  corresponds  to  it  only  one  proper  value  of^  and  one  proper  function  (f> 
Ctt)*VT  ht  ;  (u)  with  A  being  determined  from  the  condition  that  (j  (u)  is  normal¬ 


ized,  i.e.,  that 


1  * 

The  relationship  TT"  ^ (*)*** ^ 3*  thus  constitutes  the  dispersion  of  noise 


at  the  output  of  an  rf-anplifier. 

From  (9.26)  we  find  in  this  case 


e»<".')=77 


_ _ 1 


s*  U) 


(9.33) 


Kl—  2/a*J 
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n 

where  s£(t)  is  a  signal  which  has  passed  through  the  rf-amplifier. 

Since  the  output  filter  has  an  unrestricted  banc,  formula  (9.33)  yields  the 
expression  for  the  characteristic  function  of  the  square  of  a  normal  random  process 

p 

with  a  dispersion  of  <f  An  inverse  Fourier  transformation  of  it  coincides  with 
(9.12)  (tfith,  of  course,  the  appropriate  replacement  of  O'  by  Cj,  and  of  s^  by  a). 
From  (9.31)  we  have  in  this  case 


««<n.  ”**» 

»•  l-2ixn* 


(9-3*0 


e'(!’'''l=ra^e 

where  «  (t)  is  the  envelope  of  a  signal  at  the  output  of  the  rf-amplifier.  Formula 
(9.3*0  yields  the  expression  for  the  characteristic  function  of  the  square  of  the 
envelope  of  a  normal  random  process.  Its  inverse  Fourier  transformation  coincides 
with  (3; 20). 

Let  us  note  that  the  method  set  forth  above  may  be  generalized  and  employed  for 
calculation  of  the  multi-dimensional  characteristic  functions  of  a  random  process  at 
the  output  of  a  standard  section  of  the  type  under  consideration  . 

5.  An  Approximate  Method  cf  Determining  the  distribution  Function 

With  the  exception  of  one  special  case,  cited  at  the  end  of  the  preceding 
section,  the  solution  of  integral  equation  (9.32)  is  a  sufficiently  laborious  process. 
Since,  besides,  in  the  majority  of  cases  in  practice  this  solution  is  obtained  by 
approximate  methods,  it  is  worth  our  while  to  consider  the  approximate  methods  of 
directly  determining  the  distribution  function  of  a  process  at  the  output  of  a  filter, 
avoiding  the  stage  of  solving  integral  equation  (9.22).  One  such  method,  consisting 
in  the  computation  of  a  number  of  distribution  moments,  was  cited  in  £8,  Chapter  VI. 
This  method  may  be  applied  in  detail  to  the  problem  considered  in  the  present  chapter, 
if  account  is  taken  of  (9.26)  or  (9.31). 

Let 'us  regard  as  numerical  characteristics  of  the  random  processes  at  the  out¬ 
put  of  a  filter  not  the  moments,  but  the  cumulants  (cf.  p.  109)of  one-dimensional 
distribution. 
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La^MS*. 


(9.3?) 


^  vl^  <^“*>w»»-*  .,. . 


».«=  (2=’),4{-i-  Jk«(«,  u)du+  ■ 

■■  09 

«•  00 

+  *M[  j  5  (/  -  a)  /C(">  («,  o)  S  (f  -  o)  </«</„  J  . 


(9.40) 


Thus,  employing  (9.40),  it  is  possible  to  determine  arbitrary -order  cumulants 
of  the  one-dimensional  distribution  function  of  a  random  process  at  the  output  of  a 
filter,  without  solving  the  integral  equation.  It  is  net  difficult  to  write  an  ex¬ 
pression,  analogous  to  (9.40),  for  the  cumulant  of  the  envelope  as  well.  If  the 
signal  is  absent,  then  the  double  integral  in  (9.40)  disappears. 

After  some  number  of  the  cumulants  of  a  random  process  has  been  found,  the 
question  arises  as  to  the  means  of  their  employment  in  the  approximate  determination 
of  a  one-dimensional  distribution  function.  The  desired  distribution  function  is 
for  this  purpose  usually  represented  in  the  form  of  a  resolution  into  assigned  ortho¬ 
gonal  functions;  the  coefficients  of  this  resolution  are  expressed  in  terms  of  the 


distribution  cumulants.  As  the  system  of  orthogonal  functions  into  which  the  reso- 
lutior.  takes  place,  there  is  usually  taken  the  function  ?(x)=_L.e  1  ^nd  its 

V  2k 

derivatives  (Grammat-Charlier  series,  Edgeworth  series,  cf.  C.  Kramer  [i.e.,  Harold 


Cramer]  .  Matematioheskiye  me tody  siatistiki  [Mathematical  Methods  cf  Statistics^  , 
Moskva,  For.  lit.  Pub.  Hse.,  1143).  Sometimes  it  is  more  convenient  to  employ  a 
resolution  of  the  distribution  function  into  a  series  on  the  basis  of  the  Laguerre 
functions  [2]  . 

Let  us  cite  here  an  expansion  into  an  Edgeworth  series.  Let  w^(x)  be  the  de¬ 
sired  distribution  function  of  the  random  process  at  the  output  of  a  filter,  and  k^ , 
kj,  be  the  first  three  cumulants  of  ’this  distribution.  Then  the  first  four  terns 


of  the  expansion  of  w^(x)  into  an  Edgeworth  series  have  the  form  of 


(*)  «  (Y*/)  3!  *V.  ?<J>  (  /*,')  + 


(9.41) 


-1 


!  5 


f  ; 


1  . 


s 

g 


t  -J 
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x* 

i — _L  "*" 


where  (^  ^ lf  are  derivatives  of  fW=y^e  *»  and  the  magnitudes 
and  K^»  coincide  with  the  coefficients  of  asymmetry  and  excess  of  dis¬ 
tribution  w-^(x)  [cf.  (3-63 ) 3  . 

Let  us  note  that  the  Edgeworth  series  has  already  been  employed  earlier  in  |2, 
Chapter  IV  in  an  evaluation  of  the  rapidity  of  convergence  of  the  distribution 
function  of  a  sun  of  independent  random  variables  with  a  normal  one.  A  comparison 
of  (9.M)  with  (4.19)  establishes  the  complete  identity  of  the  two  equalities. 

Figure  71  shows  graphs  of  the  derivatives  (j>  ^(x),  and  (j>  ^(x)  with 

such  coefficients  as  they  have  when  they  enter  into  expansion  (b.hl).  The  curves  of 
(x)  and  (J>'°^(x)  are  symmetrical  with  respect  to  x  =  0,  and  the  third  deriva¬ 
tive  (j>  <3)(x)  introduces  an  asymmetrical  element  into  the  expression  cf  the  dis¬ 


tribution  function. 


Lfltr) 


mi 


Fig.  71.  Derivatives  of  the  function  f  (*)*=—:  e  2 

V  2k 

6.  Example  of  Calculation  of  Distribution  Function  cf  Process  at  Filter  Output 


As  an  illustration  of  the  method  set  forth  above,  we  cite  the  example  of  cal¬ 
culating  the  distribution  function  of  a  random  process  at  the  output  of  a  standard 
section  consisting  of  an  rf-amplifier,  a  square-law  detector  and  a  video  filter  £ 2}. 
Let  the  frequency  characteristics  of  the  rf-amplifier  and  the  filter  be  sym¬ 


metrical  and  descri’oable  by  the  gaussian  curves* 


C,(»)=e  '  +e  1  . 


_ c«w=«  "i. 

*  Cf.  note  on  p.  229  concerning  the  physical  feasibility  of  linear  systems  with 
assigned  frequency  cnaracteristics. 
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The  corresponding  pulse  transfer  functions  have  the  form  of 


_ -  • 

*l(x)=T^  ^  *  cos  *°T’ 


(9.42) 


*«W=v4rPi<f  * 


(9.42*) 


The  parameters  y5  ^  and  are  simply  expressed  in  terms  of  band  of  the  rf-ampli- 
fier  and  of  band  A  of  the  filter  (cf.  p.  229) 

.  A,=  ^p„  (9.43) 


We  introduce  designations  for  the  ratio  of  these  parameters 


■_ _ h  _ 

h  5T* 


(9.44) 


Substituting  (9.42)  and  (9.42*)  into  (9.6)  and  performing  the  integration,  we  find 


K(u,  >.)— ^Micosopfr-p)  [(“+»>*+^-(«N)»J 
y^-t-2 


(9.45) 


The  iterated  second-order  nucleus  is,  in  accordance  with  (9. 37).  equal  to 


K“<«,  |  K(«.  «,K„  *tx  =5^===-  X 

X* 


(9.46) 


Analogously  the  iter^  rd  third-order  nucleus  is 


>e  ”1^+3'“ 


(«+*>’  ] 


(9.47) 


Precisely  expressed,  the  nucleus  K(u,v)  and  its  iterations  contain  second  items, 


which  are  small  to  the  point  of  disappearance  if  uQ 


Employing  (9.45)  -  (9.47),  we  find 


jK(*,#)rf«= 2p,^=A„ 


(9.43) 


**  > 


(9.49) 


(9.50) 
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Let  us  assume  that  the  determined  part  of  the  process  at  the  input  of  a 
standard  section  constitutes  a  harmonic  signal  with  a  constant  amplitude  of  S(t)®- 
A  cosw^t  (the  frequency  coincides  with  the  resonance  frequency  of  the  rf-ampli- 
fier).  Then,  taking  into  account  (9.45)  -  (9.^7),  we  find  that  the  double  integrals 


in  (9.40)  are,  for  the  example  under  consideration,  equal  to 


«0  00 

J  J S(t —  u)K{u,v)S(t  ~v)dudv=~  t 
— 00  —'00 

oo  00 

J  §S(t-u)Km(u,o)S(t-v)dudv=:y^L=.*  , 

—oo—oo  r  ^  “t"  1 

00  00 

I  f  s  (/  —  (,)  K?\u,  v)S(t — V)  dudv=  --  *** 

J  j  Vl2-A  4-  n/9v4a.al 


K(2^  +  !)(2^+3)  « 


(9.5D 


(9.52) 


(9.53) 


Substituting  (9.48)  -  (9.53)  into  (9.40),  we  obtain  cumulants  of  the  first  three 
orders  for  the  random  process  at  the  output  of  the  video  filter. 


The  first-order  cumulant  (or  the  mean  value)  is  equal  to 


C9.59) 


The  second-order  cumulant  (or  the  dispersion)  is  equal  to 

A,  =  234-^L=4-4o» -A=4  ~ 
2K*+2  K*  +  l  4  — 


(9.55) 


K5+5V  ■'•‘ir  5+T/' 


Tne  third-order  cumulant  (or  the  third-order  central  moment)  is  equal 


2  (2,1+3)  +  Vv^fT0W  T  - 
-2>i  +  3^+42c*31K 


(9.5-) 


The  coefficient  of  asymmetry  of  the  one-dimensional  distribution  function  of  a 


random  process  at  the  output  of  the  filter  is  equal  to 


Y  2-.J-H 


2m*  +  3 


H_V" 

/*+?)  ’ 

^+1  7 


07.57) 


where  *  = — 4=-  is  the  ratio  of  effective  value  of  the  signal  to  the  effective 

•K2*| 

value  of  the  noise  at  the  output  of  the  rf-amplifier. 
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It  could  be  possible,  in  a  completely  analogous  manner,  to  continue  to  compute 
cumulants  of  a  higher  order.  We  cite  merely  the  final  result: 


_  (2^,)"(n  — t)! 

*  (*  +  Kv»-r2)"-<K>*+2-,)'* 


x(i+"5S3r/ 


(^+a+»y,-(yy 


(v »* + 2 — •*)* »  y 


(9.56) 


Having  the  magnitudes  of  the  cumulants,  and  expanding  into  a  series  in  terms  of 
orthogonal  functions  [e.g.,  series  (9.41)3,  it  is  possible  with  an  assigned  degree 
of  precision  to  plot  the  distribution  function  of  a  random  process  at  the  output  of 
toe  video  filter. 

Figure  72  shows  the  curves,  obtained  by  the  indicated  method,  of  the  one-di¬ 
mensional  distribution  function  of  the  process  at  the  output  of  a  standard  section, 
for  the  case  when  only  "white”  noise  is  applied  to  its  input.  To  each  curve  there 
corresponds  a  constant  ratio  v  of  the  width  of  the  filter  band  A^  to  half  the  width 
of  toe  rf-amplifier  band  . 


ei>'~ 
li'i  • 
l  MS 

as 


9  V  jp  IS  to  V  to  V 

Fig.  72.  Distribution  function  of  process  at  output  of 
standard  section  (s  =  0) 


In  Figures  73  and  74  these  same  curves  are  plotted  for  cases  where  there  is  act- 

A  *  2  1 

ing  a  sinusoidal  signal  as  well,  the  ratio  =  s  being  equal,  respectively,  to 

one  and  to  two.  When  ▼— »oo(curves  1  in  Figs,  72,  73,  74),  i.e.,  as  the  filter 
band  width  increases,  the  curves  of  the  distribution  functions  approach  the  respective; 
curves  shown  in  Figure  6'?.  .. 

i 

It  can  be  seen  from  the  curves  shown  that,  ?s  the  filter  band  grows  narrower  * 
(v— ■*  0),  the  distribution  functions  approach  the  normal.  This  normalization  of  a  f 
random  process  at  the  output  of  a  narrow-band  linear  system  is,  as  has  been  noted  in  ; 


m 


Fig.  73*  Distribution  function  of  process  at  output 
of  standard  section  (s  =  1). 


Fig.  74.  Distribution  function  of  process  at  output 
of  standard  section  (s  =  2). 


Sect.  8,  Ch.  VI,  a  consequence  of  the  central  limit  theorem.  The  tendency  toward 
normalization  increases  with  an  increase  in  the  signal/noise  ratio  s  at  the  output 


of  the  rf-amplifier. 


In  the  first  approximation  the  degree  of  normalization  of  a  random  process  at 


the  output  of  a  filter  may  be  evaluated  by  means  of  the  coefficient  of  asymmetry  k 


the  dependence  of  which  on  ▼  and  s  is  given  by  formula  (9.57)  and  by  the  graphs  co 


responding  to  it  in  Figure  75. 


Fig.  75«  Coefficient  of  asymmetry  of  process  at  output  of  standard 
section,  in  relation  to  the  ratio  s  =  with  fixed  value  of  v  = 
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CHAPTER  X 

POWER  SPECTRA  OF  SIGNALS,  MODULATED  BY  RANDOM  PROCESSES 
1.  The  Pulse  Random  Process 


In  pulse  engineering,  which  has  undergone  considerable  development  in  recent 
years,  many  problems  lead  to  an  investigation  of  the  sequence  spectra  of  identical 
pulses.  The  basic  parameters,  characterizing  the  geometric  shape  or  position  of 
these  pulses  (amplitude,  duration,  instant  of  origin  of  leading  edge,  etc.)  can  change 
in  accordance  with  a  given  law  or  can  be  random  functions  of  time.  The  latter  takes 
place  when  the  pulses  are  distorted  by  random  interference,  or  when  the  modulation  of 
the  pulse  sequence  may  be  regarded  as  a  random  process.  A  sequence  of  pulses  whose 
parameters  are  random  variables  we  shall  call  a  pulse  random  process. 

If  the  pulse  shape  is  given  and  one  of  its  geometric  parameters  is  random,  then 
to  the  pulse  sequence  there  corresponds  a  sequence  of  random  variables,  namely:  to 
the  beginning  of  each  cadence  interval  there  may  be  assigned  a  random  value  of  the 
pulse  parameter.  Such  a  random  sequence  represents  a  special  case  of  a  random 
process  with  discrete  time,  the  theory  of  which  is  developed  in  parallel  with  the 
theory  of  random  process  with  continuous  time. 

A  pulse  random  process  is  generally  non-stationary.  Thus  if  the  moments  of 
pulse  emergence  are  periodic,  and  the  parameters  characterizing  the  geometric  shape 
are  random,  then  it  is  obvious  that  the  two  values  of  a  pulse  random  pro-^ss,  at  the 
moment  of  passage  of  a  pulse  and  in  the  interval  between  pulses,  are  independent. 

The  values  of  a  random  process  may  become  statistically  related,  if  two  moments  in 
time  are  examined  with  reference  to  the  passage  of  an  aribtrary  pair  of  pulses. 
Finally,  the  value  of  the  examined  random  function  is  uniquely  determined  for  the 
interval  between  the  pulses. 

Thus  the  correlation  coefficient  of  a  pulse  random  process  can, 'with  a  given 
magnitude  T  of  the  difference  of  two  instants  in  time,  take  any  value  from  zero  to 
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one.  The  mean  value  of  a  pulse  random  process  also  depends  on  time.  In  the  inter¬ 
vals  between  pulses  it  is  always  equal  to  zero,  whereas  for  time  instants  corre¬ 
sponding  to  the  passage  of  pulses,  the  magnitude  of  the  mean  value  may  differ  from 


zero  and  may  be  different  for  various  pulses. 


A  pulse  random  process  is  determined  by  an  infinite  number  of  realizations, 
each  of  which  constitutes  a  sequence  of  pulses.  Let  us  segregate  one  (for  instance 


the  k-th)of  these  sequences  and  examine  2N  +  1  pulses,  located  on  both  sides  of  the 


zero  pulse  linked  with  the  origin  cf  the  time  reading. 


Let  us  designate  by  Z^w)  the  spectrum  density  (Fourier  transformation)  for 


the  function  describing  this  sequence,  and  let  the  distance  between  its  extreme 


pulses  be  (2M  +  1)T.  Since  the  pulse  process  is  nonstationary,  the  mean  power  of  the  \ 


pulse  sequence  [cf.  (5.^2)]  GjtJ)  =  lim  TzjT—rif | ZM (u») |*  will  depend  on  k,  i.e.,j 


w  -'j  Tc'-'  -  "  ' 

on  that  one  of  the  realizations  of  the  pulse  random  process  for  which  this  power  is 


computed. 


In  order  to  determine  the  power  spectrum  F(t*>)  of  a  pulse  random  process,  it  is 
necessary  to  perform  a  supplementary  averaging  of  for  the  multiplicity  of 

realizations.  Thus  the  power  spectrum  of  a  pulse  process  is  determined  from  the 


relationship 


F (#)  =  m,  jo*  (»)J = m,  |lim  |  ZkH  (*)  I2) . 


(10.1) 


This  sane  power  spectrum  may  be  obtained  by  a  Fourier  transformation  of  the  cor-  ■ 


relation  function,  averaged  over  time,  of  a  pulse  random  process.  However  in  the 


subsequent  presentation,  formula  (10.1)  will  be  used  to  calculate  the  power  spectrum 


of  a  random  process,  and  the  correlation  function  of  this  process  is  found  by  means 


of  a  Fourier  transformation  of  the  power  spectrum  F(&1). 

....  . 


Let  us  examine  some  realization  £  (t)  of  a  pulse  random  process. 

To  each  pulse  there  may  be  assigned  a  numeral  -  a  number  (positive  or  negative) 


of  the  natural  series.  Let  a  pulse,  belonging  to  this  realization  and  emerging  at 


the  moment  in  time  t  ,  be  described  by  the  function 

*» 


O  .  This 
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function  must  satisfy  the  condition  0  when  t  ^  C.  The  sequence  2N  +  1 

of  the  pulses  of  the  examined  realization  nay  be  analytically  expressed  by  the  sum¬ 


mation 


jO'-O- 


Let  us  assume  tl^=nT 


where  T  is  a  positive  constant  and  let 


F  ^\cS)  be  the  Fourier  transformation  of  E  (t)  .  We  designate 

n  x  0 

V^1  =  F1^  (w)  e1*"? \  (10.2) 

Then  the  Fourier  transformation  of  O'-C)  will  be  equal  to 

fj»  (a)  ew«)«=  v^e,(,“r  (10.2* ) 

It  is  assumed  that  the  pulses  do  not  overlap,  i.e.,  that  in  each  cadence  interval 


there  emerges  one  pulse,  and  only  one.  This  condition  signifies  that  the  possible 
values  of  the  random  variable  and  of  the  random  duration  of  the  n-th  pulse  do  not 
exceed  T/2  in  absolute  value. 

Let  us  now  write  the  spectral  density  (Fourier  transformation)  of  the  sequence 
of  2N  +  1 -pulses.  Considering  (10.2*),  we  find 

**<•>-  £  V„V~r .  (,0.3) 

To  determine  the  power  spectrum  of  the  pulse  random  process  we  substitute  (10.3) 
into  the  general  formula  (10.1) 

'(•>=m'fc2.mTTr|  S  nV-l’}.  (,o.4) 

Changing  in  (10.4)  the  order  of  transition  to  the  limit  and  of  the  averaging  for  the 
multiplicity,  we  obtain 

fW  =  T&5STim‘{|  E  (10.5) 

a — M  1  1 

It  can  be  seen  from  (10.5),  that  to  determine  F(<J)  it  is  necessary  first  to  find  the 
average  for  the  multiplicity  (i.e.,  for  the  index  k)  of  lzkN(w)  r  ,  Since 

I  ZkH  (*)  I* = £*#(•)  • 
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.  — _ 


therefore 


it  it 


j  vfvJV^ 


«— #  I— It 


(10.6) 


Here  the  line  over  V  indicates  a  conjugate-complex  quantity.  Segregating  in 
summation  (10.6)  the  terms  corresponding  to  n  =  j,  we  obtain 

tt  H  N  — - 

*““*•  *~H  l—N  ' 

'  •*/ 

and  since  the  average  of  a  sum  is  equal  to  the  sum  of  the  average  items,  therefore 

*  N  (10.7) 

m—HIm-N  1 

•*■1 

From  this  point  on  the  investigation  is  restricted  only  to  such  pulse  processes, 
in  which  the  statistical  characteristics  of  the  pulses  do  not  depend  on  the  numeral 
thereof,  and  the  statistical  characteristics  of  a  combination  of  pulses  depend  on  the 
relative  position  of  the  pulses  and  do  not  depend  on  which  of  them  is  selected  as  the 
zero  one.  With  these  restrictions  the  quantity 


*<•)=">, {i  Ci>} 


(10.8) 


does  not  depend  on  the  pulse  numeral  n,  and  the  quantity 


(•)="■(  {Cv;*1} 


(10.9) 


depends  only  on  the  difference  n  -  j  of  the  numerals  of  two  pulses. 


J]  f  l)K(m), 


(10.10) 


and  the  double  summation  may,  after  the  simplest  of  transformations,  be  represented 


in  the  form  of 


‘  It  N 


«— ti  I— n 

Mil 


(10.11) 
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r“C*v***»vl 


Substituting  (10,10)  and  (10.11)  into  (10.?)  and  taking  into  account  (10,5).  we  find 


f  (.)  =4  {«  w + Hz 2  £('  ~  W  cos  p»rj . 


If  the  pulses  are  mutually  independent,  then 


where 


(-) = <".{  c  }'»,{v;’1  }= i « (»>  p. 

«(•)=">, {V"’}. 


We  designate 


nr 

«{«.)=2Jlm  J]  (l-jyTr)  [//„(»)- 1 //Hi1]  cos piur. 


Then  formula  (10.12)  may  be  rewritten  thus: 


/»=  f  (K(u.)  - \H (m)  |*+  *  («,)  + 

Vi 

+|"(”)i,jisl,+2S(,-»TT)c“H}- 


Noting  that 


A*H=I  +  2  J]  (l  -  2tr+l)  cos prnT  = 

V  Z,» r_  ,  ’ 

2N+\Jj  u  ~  2/V+l  Z?f 

it — H  l—ti  *Jn-j 


and  that 


-i - ; 

^2Af+l|  ^ 

r=0,  =tl,  d=2, ... 


•in-j-  I  loo  »r  =  2itr, 


_ jO  a >T  2 r.r. 


we  find 


lirnA*  (u>)  =  c8  ^u>  — 


where  r  is  any  whole  number  (including  zero  as  well). 


(10.12) 


(10.13) 


(10.14) 


(10.15) 


(10.16) 


For  determining  the  unknown  constant  c  we  take  the  integral  of  both  parts  of  the; 


last  equality  within  the  limits  of 


2*r  « 

T~r 


J«r  .  « 
~T.~'  T 


.  Then 
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mstmu omasa 


r(,+4) 

f  tjf. —  '~-\ii»  —  c— 

W'~S) 

t(-t) 

=j  [;l  +  2Ji2 S (*" 2*+i)  C0!'’“r]<'”  = 

?('~9 

•  -t+«S |(>-^T)'-^r^=T- 


In  this  manner 


(10.17) 


Substituting  (10.17)  into  (10.16),  we  obtain  the  following  general  expression 
of  the  power  spectrum  of  a  pulse  random  process: 


*(•)«£{«<•)  * («*)  f 


(10.18) 


in  which  the  functions  K (0)),  H(6>),  (Jtw)  and  Hp  (a>)  are  determined  by  fomulas  (10,8), 
(10.14),  (10.15)  and  (10.9). 

If  the  pulses  are  mutually  independent,  then  Hp  ( u )  =  |k  (o>)  J  and  in  (10,13) 
it  should  be  assumed  that  lj>  (jU)  ~  0.  In  this  case  the  pulse  distortions  (ampli- 
tudinal,  in  duration  and  in  position)  are  similar  to  white  noise.  In  some  problems 
the  assumption  of  pulse  independence  may  rest  on  entirely  firm  ground.  Correlation 
between  pulses  may  be  neglected,  if  the  correlation  time  T.  Thus,  for  instance 

in  examining  at  the  output  of  a  receiver  a  sequence  of  video  pulses  distorted  by 
fluctuation  noise,  these  distortions  may  be  considered  to  possess  the  character  of 
white  noise  if  the  pass  band  width  of  the  receiver,  A  ^  mjr  ,  where  Z'  is  the  pulse 
duration. 

Problems  may,  however,  also  be  encountered  in  which  it  will  be  necessary  to  take 
into  account  the  bands  of  the  previous  stages,  i.e.,  correlation  between  the  pulses.  . 

The  general  expression  (10.13)  of  the  power  spectrum  of  a  pulse  random  process  ■ 
consists  of  a  continuous  part 
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^  (“) = f  { *  ^  - 1 W IM- *  (*) } 


(to.  19) 


and  a  discrete  part 


M»)=rX»>?  2»(— r)- 


(10.20) 


which  consists  of  discrete  lines  on  frequencies  which  are  multiples  of  the  mean 


frequency  **  of  pulse  repetition.  The  ratio  of  the  full  power  of  the  components  of 


the  continuous  spectrum  to  the  full  power  of  the  components  of  the  discrete  spectrum 


is  equal  to 


m 

— 

r  S  Krjf  ' 


(10.21) 


It  is  not  difficult  to  see  that  if  distortions  are  absent,  then  K(o>)  =Jlf(w)| 
'=  |g(Cd)  (  where  g(&»)  is  the  spectrum  density  of  the  undistorted  pulse.  Here  the 


continuous  part  of  the  spectrum  disappears,  and  the  discrete  part  coincides  with  the 


power  spectrum  of  the  periodic  sequence  of  unmodulated  pulses.  Therefore,  in  those 


cases  where  the  distortions  are  caused  by  interference,  it  is  valid  to  identify  the 


continuous  part  of  spectrum  (10.19)  with  the  interference  spectrum,  and  the  discrete 


part  (10.20)  with  the  spectrum  ox’  the  useful  signal.  In  this  case  the  ratio com¬ 
puted  according  to  (10,21),  will  yield  the  ratio  of  the  power  of  the  interx’erence  to 


the  power  of  the  signal^-j.  In  other  problems  where  the  useful  modulation  of  the 
pulse  sequence  is  of  a  statistical  character  (for  instance  tne  modulation  of  speech 


in  multichannel  telephony),  the  continuous  part  of  the  spectrum  carries  useful  in¬ 


formation. 


If  the  pulse  parameters  (amplitude,  time  of  emergence,  duration)  are,  besides 


purely  random  distortions,  subjected  to  modulation  by  a  given  periodic  function  of 


time,  then  the  discrete  part  (10,20)  of  the  paver  spectrum  must  be  supplemented  by 


terms  containing  delta-functions  at  frequencies  corresponding  to  the  components  of 


the  resolution  of  the  indicated  periodic  function  into  a  Fourier  series. 


In  the  succ°eding  sections  there  are  examined  some  special  cases  of  random 
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Fig.  76.  Sequence  of  equidistant  noises  of  equal  width  and  with 

random  amplitude. 

Since  in  the  case  at  hand  ^’sO  and  Fn( u>)=  »  it  follows 

from  (10.2)  that 

;  V.^^TW*  (10.22) 

Substituting  (10.22)  into  (10.3)  and  (10.7),  we  obtain 

(10.23) 

(10.24) 

Let  w^(x)  be  the  one-dimensional  distribution  function  of  the  random  amplitude 


'*(•)««,{  E^Hl}=l?HPmf{  E*  J, 

^/W=W|{e(,l|teM2}=|«r(»)llm,{E<|Ei}. 


£  ,  equal  for  all  pulses,  i.e.,  for  any  n.  The  mean  value  of  a  and  the  dispersion 
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pulse  processes,  for  which  the  random  factor  is  one  of  the  parameters  chai’acterizlng 
the  shape  of  the  pulse  or  the  instant  of  its  emergence.  Formula  (10. 1 S)  also  permits 
an  investigation  of  more  general  cases,  when  the  indicated  random  distortions  act 
simultaneously. 

2.  Sequence  of  Equidistant  Pulses  having  Equal  Width  and  Random  Amplitude 
Let  us  examine  a  sequence  of  equidistant  pulses  of  given  shape,  which  are  of 
equal  width  and  of  random  amplitude. 

Let  us  designate  by  g(&/)  the  spectrum  density  of  a  pulse  with  an  amplitude  equal 
to  unity,  which  emerges  at  the  instant  of  time  t  =  0.  Let  us  designate  by  T  the 

period  of  repetition  of  the  pulses,  and  by  £  the  random  amplitude  of  the  n-th  pulse 

ft 

(Fig.  76). 


i  l 


i  * 

1  ,J 


(10.25) 


O'  of  the  random  amplitudes  of  the  pulses  are  equal  to 

00 

‘mi{U=a  =  “J 
— » 

90 

^2{5(l}  =  9*=:  J(*-~  fl)iWl(x)dX.  \ 

Let  w9(x,y,2')  be  the  two-dimensional  distribution  function  of  the  random  ampli¬ 
tudes  £  ,  which  deoends  only  on  the  relative  position  of  the  pulses  T, 

i.e.f  only  on  the  difference  in  the  numerals  of  these  pulses.  We  designate  by 
R\(n—j)T]  the  correlation  coefficient  of  the  random  amplitudes  of  the  pulses; 


M  (l,  “*)  (;,-<*)}  =3*/^  = 

0 V  oo 

=  j|  J  (*-<*)  (y  -  a)  y,  ( n-J)T]dxdy . 


(10.26) 


Employing  (2.74)  and  (3-53).  it  is  not  difficult  now  to  express  K(tJ)  and  Y.h  •  (<•>)  in 
terms  of  the  numerical  characteristics  of  the  random  amplitudes  of  the  pulses 


KM=|£WI2(*2  fn 

Hn-t  («)  =  |  £  (u>)  I2  («2/?„_y  +  a2). 


(10.27) 


(10.28) 


If  the  amplitudes  of  any  pulse  pair  are  independent,  then 

R,=0,  p^O. 

and  from  (10.13)  and  (10.28)  it  follows  that 

ff(u»)=ag(a>). 


(10.29) 


(10.30) 


Substituting  (10.27),  (10.28)  and  (10. 30)  into  (10.13),  we  obtain  the  final  ex 
pression  for  the  povfer  spectrum  of  the  pulse  random  process  under  consideration: 

F  («0 = f  u  w  +  M*)! + 

(10.31) 

.  r~— oo 

where  by  u>(  (to)  is  designated 

*  *  1H 

M-.WnJX1  -  srn)*’?*p“T-  Co. 32) 
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'll 


It  follows  from  (10. 31)  that  the  power  spectrum  of  a  sequence  of  equidistant  : 
pulses  of  random  amplitude  depends  on  their  correlation  function  and  does  not  depend  i 

on  the  form  of  the  distribution  function  of  the  random  amplitudes.  i 

■? 

If  the  random  amplitudes  of  any  pair  of  a  sequence  of  rectangular  pulses  are  in-  j 

'  »| 

dependent,  then  such  a  pulse  process  may  be  regarded  as  the  amplitude  modulation  of 

the  second  kind*  of  pulses  by  white  noise.  Since,  when  condition  (10.29)  is  ful¬ 


filled,  O  ,  it  follows  from  (10.31)  that  for  this  case  we  find 


s("- r)}- 


(10.33) 


The  continuous  part  of  power  spectrum  (10.33)  has  the  same  shape  as  the  spectrum; 


of  a  single  pulse,  and  its  intensities  are  proportional  to  the  dispersion  O'  .  The  ) 
discrete  part  of  this  spectrum  corresponds  to  a  periodic  sequence  of  pulses  of  the 
same  shape,  but  with  a  constant  amplitude  equal  to  the  mean  value  a.  Thus  with  a 


given  pulse  shape,  the  spectrum  under  examination  is  determined  only  by  two  numerical- 


characteristics,  the  mean  value  a  and  the  dispersion  O*  . 

The  power-corresponding  to  the  continuous  part  of  the  spectrum  is  equal  to 

«0 

2c* 


and  that  corresponding  to  its  discrete  part  is 


2a*  72* 


jri*W  2  5(“-r)rf“>  = 

—00  r~—o o 

-r  S  iKWr^-r 


The  ratio  of  the  power  of  the  continuous  and  the  discrete  parts  of  the  spectrum 
is  equal  to 

>-(*)’• 


(io.3*0 


i.e.,  to  the  square  of  the  ratio  of  the  mean-square  value  to  the  mean  value  of  the 
random  amplitude  of  the  pulse. 


*  As  is  well  known,  in  pulse-amplitude  modulation  of  the  second  kind,  the  amplitude! 
of  each  of  the  pulses  remains  constant,  equal  to  that  value  of  the  modulating  j 
function  which  corresponds  to  the  leading  edge  of  the  given  pulse  [51- 
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Figure  7?  shows  the  power  spectrum  of  a  sequence  of  equidistant-  rectangular  pulses 

with  a  duration  of  X  ,  nodulated  in  amplitude  by  white  noise.  j 

o  i 

'Ml  '  ! 


-JM/* 

^  v"  Discrete  spectrum 
I  :  Continuous  spectrum 


i 

Fig.  7?.  Power  spectrum  of  a  sequence  of  mutually  independent 

rectangular  pulses  with  random  amplitude.  : 

% 

From  (10.33)  it  is  not  difficult,  by  means  of  an  inverse  Fourier  transformation,  - 
to  find  also  the  correlation  function  of  a  sequence  of  mutually  -independent  rectan-  ■ 
guiar  pulses  with  random  amplitude  (Fig.  73).  Here  the  discrete  part  of  the  spectrum  | 
is  transformed  into  a  periodic  sequence  of  triangles  (Fig.  79'a):  l 


wherefrom 


i  ]|«W?*(— 

-*  s 

**<*)**[  o  ,  it ~rr;>v 


(10.35) 


r=0,  ±1,  ct2, ... 

The  continuous  part  of  the  spectrum  is  transformed  into  one  triangle,  located 


near  the  point  X  -  0  (Fig.  79  b): 


— «• 


(10.35*) 


.  I*I<V 


Let  us  return  to  an  examination  of  the  general  case,  for  which  the  function 
is  not  identically  equal  to  zerp. 


'+■■***#■*« 


* 


inequality  (10.33)  is  not  fulfilled,  but  A  ,  then,  representing  A  as  the  sun 


of  the  two  itens 


A,=  f4-A„  A,<f, 


(10.39) 


7 


we  obtain  from  (10.37) 

i  r 

=  i  Jtp(i)cosu>tda> 

A 

+  i*  J  T  (“)  COS  mx  du>  =  /?,  (x)  +  /?,  (t). 


(10. hO) 


Then  the  series  (10. 36)  may  be  broken  down  into  a  sum  of  two  series: 

♦»(*)= tiiH 4*  ♦»(•). 


(10. hi) 


where 


tiM-«  2«„  cospu>7\ 


(10.42) 


cos  p»r. 


/•-i 


(10. 43) 


The  functions  (u)  and  (fcO  are  periodic  functions,  which  (to  an  accuracy 
of  a  direct  component,  equal  to  unity)  coincide  with  the  function  :  the  first 


in  the  sector  to  ,  and  the  second  in  the  sector  from  •=•  to  A  .  Here  the  second 


periodic  function  is  shifted  with  respect  to  the  first  by  half  of  the  period  . 


The  correlation  function,  corresponding  to  this  part  of  the  spectrum,  represents  a 
sum  of  the  delta-functions  5  (r  —  pT)  with  an  intensity  which  diminishes  with  the 
growth  of  the  numeral  p. 

With  the  arbitrary  quantity  A  we  act  in  a  completely  analogous  manner,  repre¬ 


senting  the  correlation  coefficient  in  the  form  of  a  sum  corresponding  to  the  break- 


7t* 


up  of  integral  (10.40)  into  sectors  which  are  multiples  of  . 


Let  us  examine  as  an  example  the  continuous  part  of  the  power  spectrum  cf  a 
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Then  from  (10. 36),  it  follows  that  1  +  is  a  periodic  function  with  a  period 
of  -3j2f  ,  which  within  the  limits  of  to  (sic.t)  coincides  with  Lj>  (cj ).  If  the 


sequence  of  equidistant  rectangular  pulses,  modulated  in  amplitude  by  noise  with  a 
spectrum  uniform  in  the  limited  band  ^  »  In  this  case  the  correlation  coefficient 
of  the  random  amplitudes  of  any  pair  of  pulses  is  equal  to 


d  _ *ln  P-ir 

p\T  • 


(10.44) 


If  the  width  of  band  A  satisfies  the  inequality  (10. 38),  then  the  examined 
power  spectrum  will  have  the  form  of  periodically  recurring  bands  with  a  width  of 
2  A  ,  at  frequencies  which  are  multiples  of^j?(i.e.,  of  the  frequency  of  pulse  re¬ 
currence),  limited  underneath  by  the  abscissa  and  above  by  the  curve  |  (Fig. 

30).  As  A  is  increased  the  width  of  these  bands  increases,  and  when  As  jr  the  gaps 
between  the  cadence  frequencies  disappear.  In  this  case  the  power  spectrum  does  not 
differ  from  a  spectrum  with  an  endless  band  of  modulating  noise  (Fig.  77)* 


Fig,  80.  Power  spectrum  of  sequence  of  rectangular  pulses,  modu¬ 
lated  :n  amplitude  by  noire  occupy!  n,,  limited  bar’  of 

frequencies. 

Generally  with  a  band  width  of  A  ,  which  is  a  multiple  of  half  the  pulse  re¬ 
currence  frequency,  as  can  be  seen  from  (10.44),  the  correlation  coefficient  turns 
to  zero  (p  ^  0),  ana,  consequently,  <  jtffa  )  ~  0,  i.e.,  the  power  spectrum  must 

coincide  with  the  spectrum  corresponding  to  an  endless  band  of  modulating  noise. 
However,  it  does  not  follow  from  this  that  the  amplitudes  of  any  pulse  pair  must  be 
independent.  In  this  present  case  we  have  still  another  example  of  the  fact  that 
two  quantities,  for  which  R  =  0,  are  not  necessarily  independent  (cf.  p.  73  ). 

It  can  also  be  seen  from  (10.44)  that,  as  the  width  of  the  modulating  noise  band 
is  increased,  the  maxima,  of  the  quantities  Rp  for  a  given  p  diminish  in  inverse  pro¬ 
portion  to  A  ,  as  a  result  of  which  the  deformation  of  the  envelope  of  the  continuous 
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spectrum  when  A^->oo  becomes  constantly  less  noticeable.  With  AT>>  1  it  is  virtu¬ 
ally  possible  to  consider  that  this  spectrum  does  not  differ  from  a  spectrum  cor¬ 
responding  to  modulation  by  white  noise. 

3«  Sequence  of  Pulses  havin  •  Equal  Amplitudes  and  Durations,  but  a  Random  Bner/ence 


Time. 


Let  us  examine  a  sequence  of  pulses  of  given  shape  which  have  equal  amplitude 
and  duration,  but  a  random  time  of  emergence  (Fi?.  Si). 


a, 

im  ,rhrt 


*  • 


— iUl 

eCm 


M^h- 

n  m 


tr 


Fig.  Si.  Sequence  of  pulses  having  equal  amplitudes  and 
duration,  but  a  random  emergence  time. 


Let  £(CJ)  be  the  spectrum  density  of  a  pulse  emerging  at  the  time  instant,  t  =  0. 


Since  in  the  case  at  hand  Fn(«)  =  g(6>),  it  therefore  follows  from  (10.2)  that 


V. =*(•)*  *• 


(10.45) 


Substituting  (10. 45)  into  (10.8)  and  (10.?),  we  obtain 


K (m)  =  m,  { (  #(«.)  |2 }  =  U  (°0  |*; 


(10.46) 


(10.4?) 


I^t  w.j  (x)  be  the  one-dimensional  distribution  function  of  the  random  variables 
,  equal  for  all  pulses,  i.e.,  for  any  n,  and  let  w^'x.y,  t)  be  the  two-di¬ 
mensional  distribution  function  of  these  random  variables,  depending  only  on  the 
relative  position  of  the  pulses,  i.e.,  on  the  difference  n  -  j  of  the  pulse  numerals. 
We  also  introduce  the  characteristic  function  0,  of  the  two-di- 

4m  •  ^ 

mensional  law  of  distribution 


•O  00 

02  (®t.  *j.  t)=5  J  J®j(jc,  y,  tdyt 
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rikto&kabi.  ■< *acK4.£jAt»*j' 


a  a  i  a  a  -  v>  >»:y. 


with  the  aid  of  which  the  expression  (10.4?)  can  be  rewritten  in  the  form  of 


#«_/(<“)=!*»  I2  ©j  [«*,  —  ®,  (n—j)  r]. 


(10.48) 


If  the  moments  of  emergence  of  any  pair  of  pulses  are  independent,  then 


H—t  (°») = I  ft  (*)  l*=k  (<•*)  I2 1  0,  (®)  |», 


(10.49) 


where  0A(W)  is  the  characteristic  function  corresponding  to  the  one-dimensional  dis¬ 
tribution  Wj(x). 

We  designate  by  (j>  ^(O)  the  limit  ' 


•  («)  =  2Jim  J](i- {02  [«>,  —  (n— /)f]  — 1 0,  (,„)  p}  cos  p^f 


(10.50) 


Substituting  (10.46)  and  (10.4"))  into  (10.18)  and  employing  (10.50),  we  find  the 
final  expression  for  the  power  spectrum  of  the  pulse  random  process  under  examination 


^  (“)  =  7- 1  £  H  I2  {1  — !  01 M  |2  -Ha  (*)  + 

+  y-|0,(®)la 


(10.51) 


Distinct  from  spectrum  (10.31),  the  power  spectrum  (10.51)  defends  oil ‘the  char¬ 
acteristic  functions  of  the  distribution  laws  of  random  deviations  from  the  pulse 
emergence  time  nT,  the  square  of  the  modulus  of  the  pulse  spectrum  density  serving, 
as  in  (10.31),  as  a  pr- portion *.lity  factor. 

When  the  random  moments  of  emergence  of  any  pair  of  pulses  are  independent, 
which  corresponds  to  time  modulation  of  the  second  kind*  by  white  noise,  then 

8,(®,  —  •,  pT)  =  1 0k  (iu)  |2, 

and  from  (10. 50)  it  follows  that  £  O  ■ 

From  (10.51)  for  this  case  we  have 


f»=fle(«>l’{i-ie.(-)l’+ 

+-?-!«> <*»*  £  *(*- Tr)|- 


(10.52) 


*  As  is  well  known,  with  pulse-time  modulation  of  the  second  kind,  the  position  of 
each  of  the  pulses  in  a  given  cadence  period  is  determined  by  the  value  of  the  modu¬ 
lating  function  at  the  beginning  of  this  cadence  period  [5]  . 
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From  (10.52)  it  can  be  seen  that  the  intensities  of  the  discrete  part  of  the 
power  spectrum,  with  time  modulation  of  the  second  kind  of  the  pulses  by  white  noise, 
are  proportional  to  I6!  (< 0 )  | 1  ,  and  the  intensities  of  the  continuous  part  of  the 
spectrum  are  proportional  to  1  -  i.e.,  in  sum  these  intensities  are  equal 

to  the  square  of  the  modulus  of  the  spectrum  density  of  a  pulse  (the  power  of  a 
single  pulse). 

The  power  of  the  process  corresponding  to  the  continuous  part  of  the  power 
spectrum  consists  of 

«0 

and  that  corresponding  to  its  discrete  part  is  approximately  equal  to 

0» 

— «o 

4.  Examples 

Let  us  examine  several  specific  examples  cf  sequences  of  pulses  with  equal  ampli 
tudes  and  durations,  but  which  emerge  at  random  moments  in  time. 

A.  Modulating  noise — normal 

Let  the  deviations  of  the  emergence  time  of  the  pulses  from  the  mean  value  con¬ 
stitute  a  normal  stationary  random  process*  (modulating  noise)  with  a  zero  mean  value 
and  a  correlation  coefficient  of  R(j'),  The  one-dimensional  and  two- dimensional  char¬ 
acteristic  functions  of  the  process  are  equal  to  £cf.  (3*79)  and  (3*95)] 


—  ~  —  ?•[*?  +  M  (<) 

0j(»)  =  e  ,  e2(»i,  »2,  *)  =  e 


(10.53) 


Substituting  (10.53)  into  (10. 50),  we  obtain  (under  the  assumption  that  ^  {Rp1 

F«i  f 

converges)  as  expression  of  the  function  <T, M  in  the  indicated  example 


e— ***(,-V  — e— •* 


j  cos  p*T= 


(10.54) 


(t~**r*  -  ljcosp.r, 


/-» 


*  Here,  of  course,  is  violated  the  condition  of  non-overlapping  formulated  in  #1. 
However,  if  the  dispersion  or  *  of  the  modulating  noise  is  small  in  comparison  to  T^, 
the  error  due  to  the  violation  of  the  indicated  condition  will  be  negligible. 
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where 


R,*=R(pT). 


Resolving  the  exponential  function  into  a  series  and  changing  the  order  of  sum- 
nation,  we  find 

■*  *  2  RjCospmT 

*-i  pZ\ 

and,  introducing  the  designation 


tj»  =  22]  Rk,*xp»T, 


(10.55) 


we  obtain 


(10.56) 


We  designate  by  the  Fourier  transformation  of  the  k-th  degree  of  the  cor¬ 


relation  coefficient 


«0  fjd 

f *(<■»)=  j  K*  (t)  €~l"*dx  =  2  f  /?*  (t)  cos  u>t  dx. 
— «o  0 


(10.5?) 


Ihen  under  conditions  analogous  to  (10. 3S)  and  (10.39),  expression  (10.55)  re¬ 
presents  a  Fourier  series  (era  sum  of  Fourier  series)  of  a  periodic  function  with  a 
period  of  •  coinciding  within  the  lira'  ts  of  one  period  with  .  If  the 

spectrum  of  the  modulating  noise  is  uniform  in  the  limited  band  A  ,  and,  consequently, 
the  correlation  coefficient  satisfies  the  relationship  (10.^),  then  (u) 

represent  respectively  a  periodic  step-shaped  and  a  periodic  saw-tooth  function. 

When  the  width  of  band  A  of  the  modulating  noise  is  a  multiple  of  half  the  pulse 
recurrence  frequency,  R^  =  0,  as  can  be  seen  from  (10.55),  f*  (*»  s  O  •  :  n  this 

case  the  power  spectrum  coincides  with  the  spectrum  corresponding  to  an  endless  band 
of  modulating  noise,  and  has  the  form  of 


'M-f  If  MP{1 -«•*■+ 

+  T«-~ 


(10.58) 


F-TS-9”H/V 


-d.  (ui  aJtCd hSd*. . .  <S 


is**, Jf.^^LtJa.TUICi  ‘,As;  --y-dU-iS.  . 


393 


Figures  32  and  83  show  the  power  spectrum  and  correlation  function  of  a  periodic 
sequence  of  rectangular  pulses  with  a  constant  amplitude  of  uQ  and  a  duration  of 
whose  instant  of  emergence  is  distorted  by  white  normal  noise  with  a  dispersion  of 


Fig.  82.  Power  spectrum  of  a  sequence  of  mutually  independent 
rectangular  pulses  emerging  at  a  random  instant  in  time. 


m 

J 
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Fig.  83.  Aperiodic  part  of  the  correlation 
function  of  a  sequence  of  mutually  independ¬ 
ent  rectangular  pulses,  emerging  at  a  random 
instant  in  tine. 


The  power  of  the  discrete  part  of  spectrum  (10.58*)  in  the  case  under  examination 

f 


is  equal  approximately  to 


* l  f 

«*P  J 


tin* 


and  the  power  of  the  continuous  part  of  this  spectrum  is 


*4  f 
«*r*  J 


tln*-y 


i 


When  o'  ,  employing  an  asymptotic  resolution  for  ♦  (X)  [cf.  (1.4C)  and 


(2.20)  ]  ,  we  obtain 


_  2' 


W 


t’iV  '^->yi"»^»','lii,5 '  2**(  » tlfji 


B.  Exponential  distribution  of  the  modulating  noise. 

Let  the  one-dimensional  and  two-dimensional  distribution  functions  of  the  time 
intervals  between  pulses  be  riven  by  expressions  (3.20’)  and  (3.19)*.  The  charac¬ 
teristic  functions  corresponding  to  them  are  determined  by  formula  (3.2^).  It  fol¬ 
lows  from  this  formula  that 

©a(®.  —  “)=  r+wo-i?*)  *  ®»(<”)==r^/«*u* 

Then  from  (10.50)  (under  the  assumption  that  ZKI  converges),  we  obtain  the  fol- 

p-i  r 

lowing  expression  of  function  t  C<o) 


♦.0=^2 


cospoT. 


Pm  I  '  - 

In  accordance  with  (10. 51)  the  power  spectrum  of  the  pulse  random  process  under  ex¬ 


amination  has  the  form  of 


,w=»,iW,(r±^[.+2|T_^x 

xcos^rj-f^^^  £  «(<— ^)).  (io.59) 


!  (10.59) 


If  the  spectrum  of  the  modulating  noise  is  uniform  in  band  £  ,  which  is  a  multi¬ 
ple  of  half  the  pulse  recurrence  frequency,  then  =  0(p  ^  1).  Then  the  power 
spectrum  coincides  with  the  spectrum  corresponding  to  modulation  by  white  noise,  and 


from  (10.59)  we  find 


fW^fifWi’^o+TT+WS  »(— r)}- 


C.  Other  forms  of  distribution  of  white  noise 


(10.5^) 


Let  us  examine  two  more  examples  of  the  position  modulation  of  pulses  by  white 
noise.  Let  the  noise  distribution  be  uniform  over  the  interval  from  —  «T  to  <  T 

*  Let  us  note,  that  if  in  the  exponential  distribution  (2.20’)  the  substitution 
Vt  *  is  made,  we  obtain  w (jft)  =  .  i.e.,  the  probability  that  a  random 

variable  distributed  according  to  Poisson’s  law.  (1.5U)  ’.rill  not  emerge  during  the  period 
of  tine  t.  Cf.  also  note  on  p.  393  . 


a 
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.  Tne  corresponding  characteristic  function,  according  to  (3*85)# 
is  equal  to  ... 


®i(«)  = 


■in  aur 

M.r 


Tne  power  spectrum  in  this  case  has  the  form  oi 


,  tin1  auT  , 

1  T" 


,  2*  *in*  ««T 

*>  T  •*w*r* 


S  •(-*)]■ 


(10.60) 


If  the  noise  distribution  is  equal  to  [  cf .  (3.16)] 


“r  V13X 

,  r  1  «»r» 

then  the  corresponding  characteristic  function,  according  to  (3.?0),  is 


9iW=/iM, 


and  the  power  spectrum  is 


(10.61) 


f  (..!)  + 

+¥4*nt*(—¥)]- 

5.  Sequence  of  Equidistant  pulses  with  Equal  Amplitude  and  Random  Duration. 

Still  another  type  cf  pulse  random  process  of  great  practical  importance  is  a 

sequence  of  pulses  of  given  shape,  which  have  the  same  amplitude  and  random  duration. 

r.r 


i»hl>n»n 


Fig.  84.  Sequence  of  equidistant  pulses  of  equal  amplitude  and  random 

duration. 

Let  g(&>,  £^)  be  the  spectral  density  of  a  pulse  emerging  at  the  moment  of  time 
t  =  0.  We  designate  by  $n  the  random  duration  of  the  n-th  pulse  (Fig,  3U).  Then 


(10.62) 


Since  the  pulses  are  emerging  at  constant  intervals  in  time,  equal  bo  X,  3*  0  , 
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and  from  (10.2)  it  follows  that 

vr»=^.(“)=fi(u>.  y. 


(10.63) 


Substituting  (10. 63)  into  (10. 8)  and  (10.?),  we  obtain 


*<•)=«.  [|*K  Ul*}> 

Hm-I  (*) = mi  {g  (<*».  y  £  K  *,)}• 


(10.64) 


(10.65) 


Let  ¥^(x)  be  the.  one-dimensional  distribution  function  of  the  random  durations 


E  ,  the  same  for  all  pulses,  '.e.,  for  any  n,  and  let  w_(x,  y,  If)  be  the  two-di- 

n  / 


mensional  distribution  function  of  these  rardxi  Variables,  depending  only  on  the  rela¬ 


tive  position  of  the  pulses,  i.e.,  on  the  difference  n  -  j  of  the  pulse  numerals. 


Then  from  (10.64)  and  (10. 65)  it  follows*  that 


*(•)—  Jls(®.  (x)dx. 


(10.66) 


Q»  * 

#*_/(•)  =  J  j 'g(*,  x)g~(^Ty)wi[x,  y,  (n~J)T]dxdy. 


(10.6?) 


If  the  widths  of  any  pair  of  pulses  are  independent,  then 


where 


a»  0* 

#_/(“)«=  J  g(*,x)wl(x)dx  •  jg(»,y)w,(y)dy-. 

— <0  -00 

00  2 

=  j^(»,x)w,(x)rfx  =  I //(«*)  I*. 

00 

#(•)=  (<".*)«>,  (x)dx. 


(10.63) 


(10.68* ) 


We  designate  by  (1)  («)  the  limit 

*  *  w 

♦j (•) = 2 (l  ~  Sv^pr)  f  (®)  ~  I H  (®)  I1]  cos  pmT. 


(10.6?) 


Then  from  the  general  formula  (10.13)  there  follows  the  final  expression  of  the  power 


spectrum  of  the  pulse  random  process  under  examination 

■  'M=4(JCH-|ffMI’+fcM+ 


(10.70) 


*  Strictly  speaking,  the  limits  of  integration  should  be  restricted  by  the  interval  < 
(0,  T).  Here  unrestricted  integration  limits  are  taken  conditionally  considering  the  "j 
footnote  on  p.  3??  •  r 
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in  whicVi  the  function  K(6J),  H(6J),  (^(w)  and  H^'w)  are  determined  by  formulas  (10.66) 
-  (10.69). 


In  distinction  from  spectra  (10.31 )  and  (10. 51),  in  power  spectrum  (10. 70)  the 


statistical  characteristics  of  the  process  and  the  spectrum  density  of  a  single  pulse 


cannot  be  separated,  they  enter  jointly  into  function  K(w)  and  Hp(<J). 


If  the  random  widths  of  any  pair  of  pulses  are  independent,  which  corresponds 


to  time  modulation  of  the  second  kind*  by  white  noise,  then  H^(w)sjHfCi))Jt’  and  from 
(10.69)  it  follows  that  ^(W^SO.  Then  from  (13.70)  for  this  case  we  have 


f(«)*=7{M»)Hff((i)P+  £  8 (10.71) 

*  t  OO 


With  very  small  dispersions  of  random  pulse  widths,  power  spectrum  (10.70)  does 


not  differ  in  structure  from  the  spectrum  of  a  sequence  of  equidistant  pulses  with 


random  amplitude.  In  fact,  with  smaller  instances  of  x,  the  function  g(u,  x)  may  be 


resolved  into  a  Taylor  series,  being  limited  by  the  linear  tern 


(10.72) 


Since  g(«J.O)  S.  0,  it  follows  from  (10.67)  and  (10.72)  that 


j  f  y.pT)dxdy. 


Considering  that 


(£),.. = (&),-. 


«  00 

j  j  (x,  y,  pT)  dxdy =  fi,  (pT), 


where  b^(?)  is  the  correlation  function  of  the  random  pulse  widths,  we  find 


^T)> 


(10.73) 


*  As  is  well  known,  with  pulse-width  modulation  of  the  second  kind  the  width  of  each 
of  the  pulses  is  equal  to  the  value  of  a  modulating  function  corresponding  to  the 
leading  (or  trailing)  edge  of  the  given  pulse  [5]  • 
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from  which  it  always  follows  that 

I'W-©*  *■<»>=(&)’ 

where  2£ and  O'  are  the  mean  value  and  the  dispersion  of  the  random  pulse  width 
Substituting  (10. 73)  -  (1C. 75)  into  (10. ?0),  we  find 


(10.74) 

(10.75) 


where 


h‘)=t$L  {”+”l£2S  + 

*(—¥))• 

f— 09  ,  ' 

R  — 


(10.76) 


(10.76* ) 


Comparing  (1C. 76)  with  (10.31),  we  become  convinced  that  the  power  spectra  of  pulse 
sequences,  modulated  in  amplitude  and  width,  have  the  same  form  with  small  temporal 
deviation. 

6.  Unilateral  Modulation  of  Rectangular  Pulses  in  Width 
Let  rectangular  pulses-with  a  height  of  ^  emerge  periodically  at  intervals  of 
time  T,  and  let  the  width  modulation  take  place  as  the  result  of  random  shifting  of 
the  trailing  edge  of  the  pulse.  Let  us  designate  by  2£  the  width  of  an  unmodulated 
pulse  and  by  ^(x,  y,7r)  the  distribution  function  of  the  random  deviation  from 
The  function  g (<*>,  x)  in  the  case  under,  examination  will  be  equal  to 


vf* 


*(•.  *)=«0  J  e,w<//=£(e'“V“x—  1). 


(10.77) 


Substituting  (10.77)  into  (10. 67),  we  find 

4  *0  01 

u*  m  a 


#,<•)=£{  j - 1)  x 

X  -  !)«,(*, y.  pT)dxdy= 

-^(1+ f  ,{x,y,pT)dxdy^ 

H0*H» 

m  m 

—e1**  J  t,m“  w,  (x)dx  -  e”1-**  J  ew#/  w,  (y)  rfy, 
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and,  introducing  the  characteristic  functions  of  the  random  width  deviation,  we  ob- 


*>)  =  S’ t 1  +  ©a («> . - »,pT) - eUr* e, (•) - 6,  (-«)].  (10#73) 

From  (10.72),  directing  p  — ►  we  obtain  j  H(<J)  j  ,  and  with  p  =  0  we  obtain  K(fc>): 


|  («»)  I* = ^5.  [1  -V*  1 0,  («»)  | 2  —  eto,#  0,  (w)  —  tT1"*  0i  (—  »)]. 


*(•>  =  Hi  [2  ~  e"'-  6,  (•)  -  e~<“T*  e,  (-  •)], 
K  (o>)  -  \H  («)|* = -£’ ( 1  -I  ©i(“)lJl- 


(10.78*) 


(10.78") 


(10. ?8»'') 


With  modulation  by  white  noise  the  continuous  part  of  the  spectrum  has  the  form 


F,(«.)=2?(i~ie,(«)i*i, 


(1C. 79) 


and  the  discrete  part 


e.  M “pji  I : I  + 1 8,  (»’>  Is  -  e1"-  9,  <•>  ■ - 


(10.7?*) 


If  the  random  deviations  of  pulse  width  from  2^  are  subject  to  the  normal  law* 
with  a  zero  mean,  a  dispersion  ofo^and  a  correlation  coefficient  of  R(r),th;n,  con¬ 
sidering  (10.53).  we  obtain  from  (10.73) 


^ 4 ( 1  +  ^ V ~ ^ ~ *** e~ **  ) . 

W  —  ^  +  «”*MI  —  2e  2  cos  u»t#^ . 


(10.80) 


From  (10.73*)  and  (10,73”)  we  also  find 


3  /  «*»’  \ 

|tf(-)l*=-S(v>  +  ^-2e"  1  cos»tcJ. 

2  j  /  _»M  \ 

K(u>)=-l£y~*  2  cosu^J. 


e  COSmtj 


(10.81) 


(10.81*) 


*  Cf.  footnote  p.  302 
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Substituting  (10.30)  and  (10.31)  into  (10.5?),  we  obtain  (under  the  assumption  that 

SlU  converges)  an  expression  for  the  function 

Pa  i  * 

r  °* 

^(Ui)=-^°e~<,“,JJ  (eV*-*  _i)  cos  pu,r. 

Expanding  the  exponential  functicn  into  a  series,  changing  the  order  of  summation  and 
designating 


m 

♦a*(«)=2  R*cospu>T, 


we  obtain 


(10.32) 


(10.83) 


The  functions  ^^(4J)  do  not  differ  from  the  function  ^^(w)  examined  above  J^cf. 
(10.55)]. 

Substituting  (10,31),  (10. Si*)  and  (10. S3)  into  the  general  formula  (10.70),  we 
obtain  the  power  spectrum  of  a  sequence  of  rectangular  pulses  with  unilateral  width 
modulation  by  normal  noise 


k-i 

+r(l+e-'-,-2e'^'cos.Tt)  »(“- t)|- 


(10.84) 


With  modulation  by  white  noise  the  summation  along  k  in  (10.34)  is  absent,  since 
here  =  O  .  Just  as  in  the  types  of  pulse  random  processes  examined  above, 

with  modulation  by  uniform  noise  with  a  limited  band  the  power  spectrum  turns  out  to 
be  the  same  as  for  white  noise,  if  the  width  of  band  A  is  a  multiple  of  half  the 
pulse  recurrence  frequency.  Figure  85  and  36  show  the  power  spectrum  and  the  cor¬ 
relation  function  of  the  sequence  of  rectangular  pulses  with  unilateral  width  modu¬ 
lation  by  white  normal  noise  with  a  dispersion  of  o*‘*«  .  As  in  the  pulse 

random  processes  examined  above,  the  power  spectrum  consists  of  a  discrete  and  a 
continuous  part,  and  the  correlation  function  correspondingly  of  a  periodic  and  an 
aperiodic  part.  However,  these  functions  have  also  their  characteristic  differences. 
Let  us  compare,  for  instance,  the  correlation  functions  with  amplitude  modulation 
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and  with  width  modulation  by  white  noise  (Figs.  ?3  and  86).  With  amplitude  modu¬ 
lation  the  width  ^  of  all  the  pulses  is  fixed,  overlapping  of  pulses  ceases  with  a 
displacement  of  and  therefore  the  periodic  part  of  the  correlation  function 

turns  to  zero  when  Ir-rTl&r. 


Fig.  85.  Power  spectrum  of  sequence  of  mutually  independent 
rectangular  pulses  with  unilateral  random  width 
modulation. 


Fig.  86.  Correlation  function  of  sequence  of  mutually  in¬ 
dependent,  rectangular  pulses  with  unilateral 
random  width  modulation. 

With  width  modulation  the  trailing  edge  of  the  pulses  is  randomly  displaced  and 
therefore  with  a  change  in  X  the  overlapping  does  not  cease  simultaneously  for  all 
pulse  pairs  in  two  realizations  of  c  pulse  random  process.  To  this  corresponds  a 
rounding  of  the  bottom  angles  and  an  expansion,  of  the  range  of  positive  values  of  the 
correlation  function.  It  can  also  be  seen  that  the  top  angle  of  the  triangle  in 
Figure  ?8  becomes  rounded  in  the  periodic  part  of  the  correlation  function  shewn  in 
Figure  86.  But  the  aperiodic  part  retains  the  angular  point  when  C  , 

Bnploying  (3*35)  and  (3*90)  and  bearing  in  mind  (10.78’)  and  (10. 78"),  it  is  not 
difficult  to  write  the  expression  of  the  power  spectrum  of  a  sequence  of  rectangular 
pulses  With  unilateral  width  modulation  by  white  noise  in  those  cases,  where  the  at¬ 
tribution  of  this  noise  is  uniform  or  coincides  with  the  distribution  of  harmonic 

40  ; 
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vibration  with  a  random  phase.  In  the  first  case, 


K  t,..\ 2u0  /,  *ln*awr  ,2 x{ t  n  Jlnawf  , 

-5if  \‘  -  f  ( 1  ~  2  ~'wf  COSu)to  + 


*lo*6Ka7’ 


(10.35) 


and  in  the  second 


M«> = {l  - 4  M + f  U  -  2/, («»r)  cos  u.T0  4- 

+«« <«•*>]  |j  *(—¥)}• 


(10.36) 


In  (IO.85)  and  (10,86)  the  quantityaT  is  equal  to  the  maximum  possible  displacement 
of  the  trailing  edge  of  the  pulse. 

From  a  comparison  of  (10.34),  (10.35)  and  (10.36)  with  (10.58'),  (10. 60)  and 
(10.61),  it  can  be  seen  that  the  continuous  parts  of  power  spectra  of  sequences  of 
rectangular  pulses  with  constant  amplitude  and  width,  emerging  at  a  random  instant 

in  time,  differ  from  the  corresponding  spectra  with  unilateral  modulation  in  duration 

*2,  »  / 

only  by  the  factor  4  sin  — ^  *. 

In  Figure  8?  are  superposed  the  continuous  parts  of  the  power  spectra  of 
sequences  of  rectangular  pulses  with  unilateral  width  modulation  by  white  noise  for 
the  three  shifts  examined  above.  For  comparison  (broken  cun/e)  there  is  also  in¬ 
cluded  the  continuous  spectrum  of  a  sequence  of  rectangular  pulses,  modulated  in 
amplitude  by  white  noise.  All  the  spectral  densities  refer  to  the  corresponding 
values  when u)  =  0,  which  are  not  difficult  to  determine  from  (10.84)  -  (10.86): 


2  «2«»n 

**  9T  • 


(10.8?) 


(for  normal  noise  the  maximum  edge  displacement  is  assumed  to  be  ce  T  a?  3  O'  ) .  y«.th 


A  4  |  2 

amplitude  modulation,  as  can  be  seen  from  (10. 33),  F(0)  =  —  - 


*  This  conforms  fully  with  (5*63),  since  a  sequence  of  pulses  modulated  in  position 
may  be  regarded  as  the  difference  between  a  pulse  sequence  with  unilateral  width 
modulation  and  the  same  sequence  retarded  by  the  quantity  f  . 
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Fir;.  37.  Comparison  of  power  spectra  for  three  ferns  of  distribution 
of  pulse  trailing-edge  shifts. 

1)  normal  distribution,  2)  uniform  distribution 
3)  distribution  of  sinusoid  with  random  phase. 

Since  the  spectral  densities  with<U  =  0  characterize  the  correlation  time  of  a 
random  process,  it  can  therefore-  "be  seen  from  (10.37)  that  the  minimum  correlation 

time  corresponds  to  random  edge  shifts,  distributed  according  to  the  normal  lau. 

USk - 1 - T - 1 - \ 


'3 

Fig,  83.  Comparsion  of  correlation  functions  for  three  forms  of 
distribution  of  pulse  trailing-edge  shift. 

1)  Normal  distribution  2)  Uniform  distribution  3)  Dis¬ 
tribution  of  sinusoid  with  random  phase. 
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This  is  illustrated  by  Figure  88,  wherein  are  shown  the  aperiodic  parts  of  cor¬ 
relation  functions  of  the  examined  pulse  sequences.  For  comparison  (in  Fig.  88)  is 
included  the  aperiodic  part  of  the  correlation  function  of  an  amplitude-modulated 
pulse  sequence.  In  this  figure  are  shown  the  non-dimensional  values  of  the  correlation 
functions,  obtained  through  division  by  2u0a.  Let  us  note  that  the  continuous  parts 
of  spectra,  as  well  as  the  aperiodic  parts  of  correlation  functions,  do  not  depend 
on  the  duration  of  the  unmodulated  pulse. 

7.  Bilateral  Ifidth  Modulation  of  Rectangular  Pulses 

In  the  bilateral  width  modulation  of  rectangular  pulses,  it  is  of  interest  to 
examine  the  following  two  cases. 

A.  The  leading  edge  and  the  trailing  edge  are  shifted  independently. 

Then 

?- 


•e  *  e"Xl 


(10.83) 


If  the  statistical  characteristics  of  the  shifts  of  the  leading  edge  and  of  the 
trailing  edge  are  the  same,  then  from  a  comparison  of  (10.88)  with  (10. ??)  we  become 
convinced  that,  in  the  case  under  consideration,  the  continuous  parts  of  the  power 
spectra  and  the  aperiodic  parts  of  the  correlation  functions  will  differ  from  the 
corresponding  spectra  and  correlation  functions  for  unilateral  modulation  only  by  a 
constant  factor,  equal  to  two. 

B.  The  trailing  and  leading  edges  of  the  pulse  are  shifted  by  the  same  amount, 
but  in  opposite  directions  (symmetrical  bilateral  width  modulation).  In  this  case 


*(-.*)*=*.  J  «"<«=£(< V"-r!v-,~Y 

-t-*  K  ' 

and  from  (10.87)  we  obtain 


(10.8?) 
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"  jv^y’  .y 


ff,  (®)  =  5-  l0»  (••.  “  •.  pf) + ®J  (-  «,  *.  pT)  - 
«.  pT)  -  «-*■*«,<-•,  -®,  pr)i, 

|/f  (-)!* = ^-[2 1  e,  (•)  |*  -  e]  (®)  ttm*— e]  (-  ®)  e'n 

K(«)=4l2- 0i  (2“)  e'^-  01  (-  2-)  e"^M- 


(10.50) 


(10.90* ) 


(10. °0") 


With  modulation  by  white  noise  the  continuous  part  of  the  spectrum  has  the  form 


2ftf/  if./  .  iAt  2u0 


/?.(<“)  =  ^/C(u,)l-|WWI2]^iif{2lI  -I  0i  (w)  I2]  + 

+ (0!  (“>)  -  e,  (2u))J  e'***-  4-  [6*  (— ®)  -  e,  (~  2o.)l  e"'***}. 


(10.91) 


and  the  discrete  part 


^H=-^f(2|0»(“>)lJ~0!  («») 


(10.51*) 


If  the  characteristic  function  is  even,  then  from  (1C. 01)  and  (10.01*)  it  fol¬ 


lows  that 


F *  M  ~  Sif-  { 1  “*  1 0,  (•)  I*  + 10!  W  —  0i  (2“)]  cos  tBT0}, 

a_uJ  » 

Fa  W  —  'SifT  {  I0‘  (°*)  1 2  “  0*  (°0  cos mTo}  J]  8  ^  ~  • 


(10.52) 


(10.52*) 


Comparing  (10.-2)  with  (10.79),  we  see  that  the  continuous  spectrum  with  sym¬ 
metrical  bilateral  width  modulation  differs  from  an  analogous  spectrum  with  uni¬ 
lateral  modulation  by  the  supplementary  item  ^(0j(o,)  ~ 0, (2u>)] cos u>t„ 

It  is  not  difficult  to  write  out  the  power  spectra  for  the  distribution  of 
modulating  white  noise  examined  above 


F\  («)  ((1+ e-v  cos  <*,)  (!  —  )  -f 


(10.93) 


(normal  distribution), 
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Ft (<•)  =  JlUlL/ 1  __  •to**<*T  ,  /s mwr  sin  2 a«7\ 

7  «*»r  \  +\lwi"'"2Srjcos«4  + 

+Tsaf*w?j«(— ?! 


(10.94) 


(uniform  distribution)! 


/ 

^l(*)  ~Jl  («U> f)  4*  [-/q  (ao,7’)  —  *4  (2au>7')]  COS  O)t0-f 

+  7-£  (•**■)  sin*  JJ  5^-?lrjJ 


00.95) 


(distribution  of  sinusoid  with  random  phase). 

In  order  to  illustrate  fully  the  difference  of  spectra  with  bilateral  symmetri¬ 
cal  modulation  from  those  with  unilateral,  let  us  for  instance  examine  the  case  of  a 
uniform  distribution  of  modulating  noise  and  compare  (10. 94)  with  (lO.Sp).  Trie  con¬ 
tinuous  part  of  spectrum  is  shown  in  Figure  39.  Tne  difference  from  the  cor¬ 

responding  spectrum  for  unilateral  modulation  (curve  2  in  Fig.  3?)  is  determined  by 
. ,  .  ,  <“o  /sln*awT  sin  2<wT  \  „  . 

the  item  - $ aVf~ ]  cos  mTo-  Tne  spectrum  density,  wnen  60  -  C,  is  four 

tines  greater  than  with  unilateral  modulation.  At  low  frequencies  the  supplementary 

8«*  (af)* 

item  is  equal  approximately  to  .  — — coswt0.  .  Therefore  spectrum  (10.94)  dif¬ 

fers  little  at  these  frequencies  from  (10.35).  But  at  higher  frequencies  the  dif¬ 
ference  between  these  spectra  becomes  considerable.  Figure  '90  shows  the  aperiodic 
part  of  the  correlation  function  corresponding  to  F ?(&■>).  On  account  of  the  indicated 
supplementary  item,  the  aperiodic  part  of  the  correlation  function  acquires  two  ad¬ 
ditional  maxima  at  f  =  +  t'  (compare  wltn  curve  2  in  Fig.  S3). 


'  /  l  3  *  5  $  7  a  S  K  n  fl 

otuT 

Fig.  89.  Continuous  portion  of  the  power  spectrum 
of  a  rectangular  pulse  sequence  with  bilateral  width 

modulation. 
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Fig.  90.  Aperiodic  portion  of  the  correlation  function 
of  a  rectangular  pulse  sequence  with  bilateral  width 

modulation. 

In  contrast  with  unilateral  modulation,  the  continuous  portions  of  spectra  and 
the  corresponding  aperiodic  portions  of  correlation  functions  in  this  case  depend  up¬ 
on  the  width,  2^,  of  the  unmodulated  pulse. 

Let  us  note  that  the  discrete  parts  of  power  spectra  (1C. 93)*  (10. 91*)  and  (10. 95) 
do  not  differ  from  the  corresponding  discrete  parts  of  power  spectra  (10.53'),  (10. 60) 
and  (10.61)  of  sequences  of  rectangular  pulses  with  constant  amplitude  and  width 
emerging  at  random  instants  in  time. 

The  modulation  of  rectangular  puls*,  s  in  position  is  sometimes  regarded  as  a 
special  case  of  bilateral  width  modulation,  when  the  trailing  and  leading  edges  are 
shifted  in  one  direction  by  the  same  amount  (  —  E®=t0,  ,  where  the  index  1 

refers  to  the  leading  edge  and  the  index  2  to  the  trailing  edge  of  the  pulse).  On 
the  basis  of  such  a  point  of  view  of  modulation  in  position,  it  could  be  possible  to 
repeat  anew  the  conclusions  derived  from  the  results  cited  in  Section  lx. 

8.  Evaluation  of  the  Noiseproof  Qualities  of  Pulse  Signal  in,-'  Systems 


Let  us  employ  the  power  spectra  obtained  above  for  ar.  evaluation  of  the  resist¬ 
ance  of  pulse  signaling  systems  with  pulse-amplitude  modulation  (PAM)  and  pulse-width 
modulation  (FWX)  to  fluctuation  noise.  It  is  known  that  demodulation  (i.e.,  re¬ 
storation'  of  the  modulating  signal  at  the  receiving  end)  is  effected  fcr  other  forms 
of  pulse  modulation  by  means  of  transforming  the  received  pulses  either  into  PAM  or 
?WM.  After  this  the  modulating  signal  is  segregated  by  the  a-f  filter. 

The  noiseproof  property  of  a  signaling  system  is  characteri7ed  by  the  ratio  <■£-  , 

7T 

by  which  is  understood  the  square  root  of  the  ratio  of  the  power  of  the  useful  signal 
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Pc,  in  the  absence  of  interference  in  the  pass  band  of  the  filter,  to  the  power  of 
the  noise  Py  in  the  same  band,  the  latter  being  computed  with  the  presence  of  a 
signal,  but  in  the  absence  of  useful  modulation  (cf.  Sect.  8,  Ch.  VII,  and  also  ^6]  ). 

The  process  at  the  filter  input  in  pulse  signaling  systems  constitutes  a  pulse 
random  process.  If  ?c(6»  and  F^Cd)  are  the  continuous  and  the  discrete  (except  for 
the  direct  component)  parts  of  the  power  spectrum  of  this  process,  and  C(o)  is  the 
frequency  characteristic  of  the  a-f  filter,  then  it  is  not  difficult  to  determine  the 


magnitude  of  Pc  and  Pjj  from  the  formulas 


<X> 

Pt=  ^Ft(m)C2  (u>)  dm, 

0 

00 

pn=ijf>)C2Wdu»- 


(10.9 6) 


(10.97) 


For  the  rectangular  frequency  characteristics  of  an  a-f  filter  with  cutoff 
frequency  A  ,  these  formulas  are  simplified  and  the  ratio  may  be  represented  in 


the  form 


j  Ft  (w) db> 
fiy-T - . 

■  • — (w)</w 


(10.98) 


If  T  is  the  period  of  pulse  recurrence,  and  V  is  the  width  of  an  unmodulated  pulse, 


then,  as  is  well  known, 


(10.99) 


Under  these  conditions  in  the  a-f  filter  band,  the  continuous  power  spectrum 
Fh(«)  of  a  pulse  random  process  does  not  take  into  account  the  mutual  dependence  of 
the  pulses,  i.e.,  does  not  differ  from  the  spectrum  of  a  sequence  of  pulses  modulated 
by  white  noise. 


For  a  PAH  signalling  system,  employing  (10.33)  and  taking  account  of  (10.99), 


we  find 


p  —  JL 


&!'.(*)*— Srjl*  H  \2dm  ~  if  I  g  (°)  P*  ■ ^ 


Tne  power  of  the  signal  in  the  filter  transmission  band,  with  modulation  by  a 
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\  -'•v.  -  ..  „ 


sinusoidal  signal  to  a  depth  n,  is  equal  to 


P  — - 

*  2k 


The  ratio  of  signal  to  interference  in  PAX  is,  in  accordance  with  (10. °3)  equal 


where 


a  •  V  y  • 


2k  .  0 
P  A  r  >  2. 


(10.100) 


(10.101) 


Formula  (10.101)  is  the  basic  formula  for  calculating  the  interference-killing 
feature  of  systems  vrith  PAM  in  which  the  modulating  signal  is  segregated  by  an  a-f 
filter,  and  also  of  systems  with  other  forms  of  pulse  modulation  in  which  transform-, 
ation  into  PAM  takes  place. 

Let  us  now  examine  the  ir.terferenoe-killing  features  of  a  system  with  unilateral 
PWM.  If«T  is  the  maximum  parasitic  deviation  of  the  leadin^  edge  due  to  fluctuation 
noise,  and  A  is  the  filter  band,  then  in  effect  «  T  A  <<  1 .  In  actual  fact,  with 

a  highest  reproducible  audio  frequency  of  A  =  2it  •  10  k.c  ana  a  maximum  parasitic 

c  -X 

leading-edge  deviation  of  ct  T  =  0.5*10  sec,  the  product  <*TA  *  tC  *10  ~  0.03*. 
Therefore,  as  is  seen  from  Figure  8?,  in  the  audio-frequency  range  the  continuous 
power  spectrum  vrich  the  unilateral  width  modulation  of  rectangular  pulses  is  virtu¬ 


ally  uniform.  Therefore 


=  s'".<®R 


or,  taking  account  of  (10. 37), 


p  -8"^ri 


(10.102) 


where  p  is  a  constant  factor  which  deoer.ds  on  the  form  of  distribution  of  the  modu¬ 


lating  noise  (for  normal  distri 


The  signal  power  is 


ibution  |3  s  ,  and  for  uniform  distribution^ s 

P  _ u°  ( t/n  \ 

r<-T\T)-  (10.103) 
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where  2*  is  the  maximum  useful  time  shift  of  the  pulse  leading  edge  in  modulation  by 


a  signal. 


Substituting  (10.102)  and  (10.103)  into  (10. ?2),  we  obtain 


L— Jj«  l / _l_ _!«  i/"  Ji 

n  «r  r  irA  —  «r  r  2j  • 


(10.10b) 


where is  determined  according  to  formula  (10.101). 

Formula  (10.10b)  is  also  valid  for  bilateral  width  modulation,  if  only  the 


factor  0.5  is  introduced,  since  the  spectrum  density  with  6)  =  0,  as  has  been  indicated 


in  Section  7,  is  four  times  greater  for  bilateral  modulation  as  for  unilateral. 


■Formula  (10.104)  is  the  basic  formula  for  calculating  the  interference-killing 


features  of  systems  with  F.vK,  and  also  of  systems  with  other  forms  of  pulse  modu¬ 


lation  in  which  transformation  into  PVK  takes  place. 


The  maximum  parasitic  deviation  of  the  leading  edge  (or  the  mean-square  amount 


of  noise)  is  determined  on  the  basis  of  the  characteristics  of  the  communication 


channel  in  accordance  with  well-known  formulas [sj- 


9.  Continuous-Smi ssion  Systems 


Systems  of  continuous  emission  with  amplitude  and  angle  (frequency  or  phase) 


modulation  are  widely  used  (along  with  pulse  systems)  for  the  transmission  of 


messages.  In  these  systems  the  processes  at  the  output  cf  the  modulators  represent 


high-frequency  oscillation  (the  carrier),  modulated  in  amplitude  and  phase  (frequency) 


bv  a  random  process.  This  random  process  contains  both  useful  information  (speech. 


music,  television,  etc.)  and  interference  (fluctuation  noise);  the  useful  part  of  the 


process  can,  as  has  already  been  indicated  above,  be  determined  or  random. 


To  simplify  the  exposition  we  shall  restrict  ourselves  to  modulating  processes 


which  are  normal  stationary,  random  processes.  The  method  set  forth  is,  with  certain 


computational  complicatior.o,  expandable  for  the  case  when  the  indicated  processes 


also  contain  determined  parts  . 


In  the  most  general  form  the  modulated  carrier  may  be  written  analytically  in 


the  following  manner  (mixed  modulation): 
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'A *'*■ . i* c'SaJ hi <«.  ->  >,4 


!(/)=£(/)  cos  Kf  +  $(f)J, 


(10.105) 


where  E(t)  and  lb  (t)  are  correlated  random  processes.  Let  and  Sf  be  normal, 
stationary  random  processes  which  modulate  the  amplitude  and  phase  of  the  high- 


frequency  carrier  oscillation. 


These  processes  are  slowly-changing  ones,  and  their  power  spectra  are  located 


in  the  low-frequency  range;  the  highest  frequency  in  the  modulating-f unction 


spectrum  which  is  worth  taking  into  account  is  much  smaller  than  the  carrier  frequenc 


* 


For  the  broken  linear  characteristic  of  an  amplitude  modulator,  the  link  between 


the  random  function  E(t.)  and  B,  (t)  is  given  by  the  relationship 


£(0  =  4.  +  *5.(/),  klt(t)>-Aa. 


(10.106) 


£(/)=0 


where  A  is  the  amplitude  of  the  carrier  and  m  =  k| /  is  the  modulation  factor 

°  A 

o 

Since  the  instantaneous  values  of  a  normal  random  process  nay,  on  the  absolute  scale, 


be  of  any  order  of  magnitude  whatsoever,  therefore  in  principle  overmodulation 


(m  >1)  will  always  be  in  effect.  However,  if  the  dispersion  £  6f)  is  small  in 


comparison  to  — -3-  ,  then  the  ovennodulation  may  in  practice  be  neglected.  The  rela- 

A 


tive  time  it-  of  the  over nodulatior.  is  easy  to  evaluate  from  the  eouality 


•HO  '  9 


With 

a<<  K  ,  employing  the  asymptotic  expansion  of  the  Laplace  function  (ci 
2.2C),  we  obtain 


.  _jL 

v  **  e  ?*v 


(10.107) 


Ast 


Conversely,  if  O' 3^  (very  strong  overnxodulation  ),  then,  expanding  the  Laplace 
function  into  an  exponential  series, (see  2.19),  we  obtain 


.  ~  «  I 

r  *  FUTfc’ 


(10.107’) 
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U 


■  J5.7&**£SJ> r^™  ^ 


V^~*  ,  ->  — 


Let  the  characteristics  of  the  angle  modulators  be  linear.  Then  the  link  be¬ 
tween  the  random  functions  jjW  and  Sf>  is  very  simple.  For  phase  modulation 

Wo=*,uo.  (,0-’08) 

and  for  frequency  modulation 

*,  M  <')  =  *»  fU‘  W 

5  (10.10?) 


where  k^  and  k^  are  respectively  the  characteristic  slopes  of  the  phase  and  frequency 
modulators. 

It  is  of  practical  interest  fo  find  the  general  expression  for  the  power 
spectrum  of  a  carrier  modulated  in  amplitude  and  phase  by  normal  random  processes.  In 
solving  this  problem  there  will  first  be  determined  the  correlation  function,  and 
thereupon  by  means  of  an  inverse  Fourier  transformation  -  the  desired  power  spectrum. 

The  subsequent  computations  are  greatly  simplified,  if  (lO.iQp)  is  represented 
in  the  form  of 

«(0=Re(£(0e'-'e«'(. 

In  addition,  taking  into  account  that  the  link  between  E(t)  and  £  (t)  is  provided  bv 
a  broken  linear  characteristic,  and  employing  the  representation  of  this  character¬ 
istic  by  a  contour  integral  (cf.  p.  284  ),  it  is  possible  to  write  E(t)  in  the  form 
of 


(10. tit) 


where  c  is  the  contour  shown  in  Figure  54. 


The  correlation  function  of  the  random  process  Z(*K  cf.  p  76  )  is  equal  to 

B(T)=m,  {?(/)*(/  + *)}  = 

*=yRee_,*v»n,  {E(t)E(t+ <0 

Designating  !,= «,=  H±2,  *,  =  *(/),  *,=•;.(*+*>  and  employing  (10.111), 


we  obtain 


(10.112) 
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We  introduce  a  four-dimensional  characteristic  function  for  the  four  correlated 
normally  distributed  random  variables  k4j*  Kf,-f W*  (the  mean  values  of  which 
are  assumed  equal  to  zero) 

4  4 


-f  22W.- 

®4(«».  «*.  «».  «4)  — e 


(10.113) 


where  m,  is  the  mean  value  of  the  product  of  the  k-th vand  n-th  random  variables. 

KTi 

Each  of  these  mean  values  has  the  following  sense: 

«it  =  «a»  —  ~7  (*,  (0 K  (*+*)}  = 

where  O'*  and  R  (r)  are  the  dispersion  and  the  correlation  coefficient  of  the  tnodu- 

CL  a 

lating  process 

m»s  ^  w44  “  m,  {'l'*  (Oj  =  .  (10.116) 

mM = m4,  =  m,  {-{.  (/)  $(/  +  *)} = 

=  (10.117) 


(10.114) 


(10.115; 


where  o* 
process 


(t)  are 


the  dispersion  and  the  correlation  coefficient  of  the  random 


«.a=m,i*K{MW)h;ffi.*(0).  (|0.n8) 

'  .  wu=«4.=  K{UW  +  t))  =  ^(t),  (10.119) 

*m,  {*,(/+ 1)  •{*(/)} ^fcB#.(t),  (10.120) 

mu — m4,  —  Am,  *)}  =  (0),  (10. 121) 


where  Ba  ^ it)  and  B  are  mutual  correlation  functions  of  the  random  process 

5  and  j/  (t)  . 

It  is  not  difficult  to  note  that 


m, j _ 0) (0|  ^  _|( 
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i',*e  V  "•**  <«.#«  . 


Employing  (10 . 1 1 3)  -  (10.121),  we  obtain 


**•* 

-£jy  <••?  +  «»  M.+«|> 

m>  |e<*«.*i+/«i»»+/i., e  0  ^ 

-**  <l-**>  -*  {[«.♦  (0)  -  «,♦  (t)l  «,  -  IB*.  (0)  -  B*.  Wl  «,l 
A"  ®  9  • 


(10.122) 


In  the  right-hand  part  of  formula  (10.122)  the  first  factor  represents  the  two- 
dimensional  characteristic  function  of  the  process  T0  Sa  (i*  ,  the  second  one  repre¬ 
sents  the  characteristic  function  (with  a  value  of  the  argument  equal  to  unity)  of 
the  difference  ^  (t  +  n-  <j>  (t)  *,  and  the  last  factor  takes  into  account  the  cor¬ 
relational  link  between  the  random  processes  and  (jl  (£)**. 

Substituting  (10.122)  into  (10.112  ),  we  find  the  expression  of  the  correlation 
function  of  a  carrier  modulated  in  amplitude  and  phase  by  mutually  correlated 
stationary  normal  random  processes 

^  <°>  -  *.♦  Wl »,  -  !«♦,  (0)  -  0«,  (t)| «,}  e' 


(10.123) 


-  duidu , 


(10.124) 


where 


1  Re  r  -L  r 1 **  j  j  r ' *  (5-)*  + ■!> 


2  [ii»  e 


X« 


e  «• 

,<(M ut)duxdui  1 

■M  J 


(10.125) 


Cf.  (5*62)  when  O . 


**  It  is  important  to  take  this  correlational  ]ink  into  account,  for  instance,  in 
problems  connected  with  the  investigation  of  noise  in  magnetron  generators. 
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If  the  modulating  processes  and  are  noncoherent,  then  fynj)- &<f>a.5 

0,  and  expression  (10.123)  is  considerably  simplified  and  may  be  represented  as  the 
product 

B(t)  =  BA(x)B#(t), 


is  the  correlation  function  of  the  carrier  modulated  only  in  amplitude,  and 

£.(t)  =  c“**  <*-*♦> 

*  '  (10.126) 

is  the  correlation  function  of  the  carrier  modulated  only 'in  pha’se  (or  frequency). 

10.  Amplitude  Modulation 

The  correlation  function  of  an  amplitude  modulated  carrier  by  a  normal  station¬ 
ary  random  process  is,  in  the  case  of  a  broken  linear  characteristic  of  the  amplitude 
modulator,  represented  by  formula  (10.125).  To  compute  the  double  integral  in  the 
right  part  of  (10.125)  it  is  sufficient  to  employ  the  expansion  (?.S8),  after  which 
the  integration  variables  divide  and  the  expression  for  takes  the  following 


form 


where 


Ba(i)  —  ~cc>su0x 

r-0 


*.<«■> 


r\ 

*  /*».  V 


du. 


(10.12?) 


(10.123) 


Making  use  of  the  procedure  employed  on  d.  135  ,  we  find 

(jt). 


(10.128*) 


where  vfi  (x)  =  *7=.  C  x  . 

J  Vi* 

Employing  formula  (5)  of  Appendix  VI,  the  coefficient  h  may  be  expressed  in 
terms  of  degenerate  hypergeometric  functions: 


l  f 

i 

2\**r*J  j 

rC-i 

ij‘  2-2-  2 *1*1/ 

Y2Aa 

_  r*  I 

fr  3  4  \\ 

+  ■ 

A».r(  2  ^ 

)" 

[*'  2* 

-L( 

’  *».  \-‘" 

->v 

<-■>•(£)" 

"2\ 

h 

m~Q 

ml  r  (1  'T1)’ 

+ 


(10.123") 


P.TS-°S11/V  417. 


Substituting  00.128)  into  (10.12?),  we  find 


1  ;  4 


Here  <p{  *>  (x)  —  F(x) 


flA  0)=9-  cos  «,0?  |]  -1  [r  (A-)j’  /?(  (?).  (10 .129) 

Here  9(-,) (*)  =  F (x)  =  — L-  j  e_  *  dx  -  is  a  Laplace  function  (of.  Appendix  II), 

and  * 

X 

?(-2>(x)=  J 'F(x)dx. 

—00 

Let  us  first  examine  the  case  when  O'.  in  which  the  over-modulation  may 

u  K 

in  practice  be  neglected  (cf.  (10.10?)).  In  this  case 

and  the  rest  of  the  items  in  (10.120)  may  be  neglected.  Then 

BA  (*)  =  ~T  j^'^T  +  ^a  (•) J  COS  «V  = 

A1  k * 

—  ~Y  COS  w0t  -f  T5a  (~) cos  °»o“ 

The  power  spectrum  ?  (t),  which  corresponds  to  3  (f) ,  is  equal  to 

A  A 

oe 

Fa  (•)  =  2/1*  J  COS  O)0t  COS  U>7£fc  -f- 

0 

m 

+  2A*  j  Bt  (?)  cos  u)„t  cos  u i-d-  =  -A20  S  (u>  —  w0)  -f- 

00 

+  k2  J  B%  (*5:)  cos  (o>q  —  u»)  t dx  4- 
0 
00 

Jc  &  J  Bt  (?)  cos  («>0  +  *»)  zd~. 


cos  a>0? = 


(10.130) 


With  the  assumption  that  the  bandwidth  of  the  audio-frequency  spectrum  F  (»),  which 
modulates  the  random  process,  is  much  less  thanW0  ,  the  last  term  in  the  r'.ght  part 
of  (10.130)  may  be  neglected  and  the  spectrum  of  the  amplitude-modulated  carrier  may 


be  written  in  the  form* 


Fk  (•)  =  *A\  8  (u»  —  ®a)  4* 


(10.131) 


*  Cf.  footnote,  p.  2? 5. 
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From  (IO.131)  it  can  be  seen  that,  in  the  case  at  hand,  the  spectrum  of  the  amplitude- 
modulated  carrier  is  obtained  by  superimposing  on  the  carrier  a  discrete  spectrum 
line  at  <*J  =  &0  of  the  continuous  spectrum  of  the  modulating  process,  this  spectrum 
being  multiplied  by  a  constant  coefficient  of^J^ar.d  shifted  into  the  high-frequency 
range  by  the  amount  <^0  .  This  linear  link  between  the  modulated  oscillation  spectrum 
and  that  of  the  modulating  process  comes  about  from  the  initial  assumption  of  negli¬ 
gibly  small  ovemodulation 

An 

The  other  extreme  case,  whet.  O'  j*?  corresponds  to  very  strong  ovemodulation 

^  K 

(the  relative  time  of  trvennodulatio*  'is  close  to  cf.  10.107*).  In  this  case  in 
the  summation  along  m  of  formula  (10.123*)  (sic)  it  is  possible  to  restrict  one¬ 
self  to  the  first  terms  and  then  from  (10.127)  we  find  • 

BA«  =  T  C0S(V If  h  7  ~  ~r— T\  . 

*  tZrWh-—) 


Since 


r_o 


rfl-LlllW  I.  r=l, 

\  2  /  00,  r  =  2n-\-\, 

r  =  2n  (n=  1,2,.. .), 

BAW=^cM..,(i+^.+|+i£!^«ry 


(10.132) 


The  expression  (10.1 32 )  differs  from  (7*31 )  only  by  the  factor  cosWr  and  there¬ 


fore,  taking  (7.32)  into  account,  it  may  be  rewritten  in  convoluted  form 

flA (t) = *TT  |[t  +  arc  sin  K  w]  *.  W + VT-  R]  (t)j  cosa,0t.  (10.133) 

From  a  comparison  of  (10,133)  with  (7.32)*  it  can  be  seen  that  with  strong  over- 
modulation  the  spectrum  of  an  amplitude-modulated  carrier  coincides  with  the  spectrum 

of  the  modulating  random  process  which  has  passed  through  a  linear  detector,  this 

k2 

spectrum  being  multiplied  by  a  constant  coefficient  of  and  shifted  into  the  high- 
frequency  range  by  the  amount  CJQ  .  In  distinction  from  the  ease  of  negligibly  small 
modulation.  in  the  present  case  the  modulation  is  a  nonlinear  transformation,  as 
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Fig.  91.  Power  spectrum  of  s  carrier  nodulated  ir.  amplitude 
by  a  stationary  normal  process. 


1—  negligibly  snail  cveraodulationj  2 —  strong  overncdulation. 

Figure  91  shows  the  continuous  spectra  of  a  carrier  modulated  in  amplitude  by  a 


stationary  normal  process,  tne  spectrum"  of  wrlTcft  has  the  form  of  a  gaussian  curve 


with  a  band  of  jiSlflf  ,  i.e.,  F  (&>)  «  Fc  <?  £)J 

The  first  curve  in  Figure  1  refers  to  the  case  of  negligible  over-modulation  and 
reproduces  the  spectrum  F  (y)  shifted  by  the  amount  u/##  and  the  second  curve  refers 
to  the  case  of  strong  ovorraodulamion.  Both  curves  are  normalized  by  dividing  each 


ordinate  by  F  (fc^.).  In  the  second  oase  the  spectrum  of  the  modulated  carrier  is 


somewhat  wider  than  the  spectrum  of  the  modulating  process  due  to  the  products  of 
the  nonlinear  transformation. 


persion  and  the  correlation  coefficient  of  the  random  function  (&)  ’  lin’<ed 


a  result  of  which  in  the  spectrum  of  the  modulated  carrier  there  appear  supplementary 
harmonics  from  the  beats  of  the  carrier  with  the  components  of  the  modulating  process. 
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11.  Frequency  Modulation  i 

The  correlation  function  of  a  carrier  modulated  in  frequency  by  the  normal  ; 

) 

stationary  process  with  a  linear  characteristic  of  the  frequency  modulator,  * 

is  with  <T^=  0  represented  by  formula  (10,123).  in  which  O' ^  and  ?. ^  are  the  dis-  \ 

Fn 


^ WAV  -  - 


w»i* 


K 

V 


m 


F*H~ 


2k  »*„ 
*1  A 
0. 


°<U»<1 

«*>A,  (A  <<*„). 


(10.138) 


where  O'  is  the  mean-square  deviation  of  the  frequency  from  the  carrier  (the  ef. 


Frt 


fective  frequency  deviation).  It  is  customary  to  call  the  ratio  of  to  the  maxi 


nm  modulating  frequency  A  the  effective  frequency -modulation  index  m  =  .  Employ¬ 
ing  (10.133),  we  find  from  (10.137)  after  replacing  the  integration  variable  in  the 
exponent 


it 

r 


F«im)  —  A^jt  cos  (<#  —  u>0)  xdx. 


(10.13?) 


i 


The  integral  in  the  exponent  is  expressed  in  terms  of  the  integral  since 


it 

r 


J&f*- *W)--3 

Effecting  the  substitution  T'A  =  X  ,  we  obtain  finally 

M?] 


Al  r  -«•*  1 
e 


(10.140) 


Let  us  examine  the  two  limiting  conditions  1  and  m  <s  1 .  The  first  condition 
is  equivalent  to  the  assumption  that  the  width  of  the  spectrum  of  the  modulating 
process  is  narrow  in  comparison  to  the  effective  frequency  deviation.  Such  conditions 
are  realized,  for  instance,  in  radio  broadcasting  on  ultrashort  wavelengths  and  in 


television  sound. 


*in*Y 


_  X  **  I 

In  this  case,  resolving  the  function  sir.(x)-  x  ""2'—  3*2  *  •  •  *  ,  it  is  suf- 

2 

ficient  to  restrict  one’s  self  to  the  first  term.  Then  (compare  p.228  ) 


,»*  -  *****  .#  _ _  (•—•,)* 


or 


*  MM 


2 


(10.141) 
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Thus,  in  the  frequency  nodulation  of  a  carrier  by  a  stationary  normal  random 
process  whose  spectrum  is  narrow  in  comparison  with  the  effective  frequency  deviation, 
the  power  spectrum  of  the  modulated  carrier  has  the  shape  of  a  gaussian  curve  with 
the  peak  at  point  cjx(jQ{ Fig.  9 2 ).  The  bandwidth  of  this  spectrum  is  equal  to  (cf. 
p.  229)  A,M=  K2* o,M = V2ir  m>. ' 


U>-LM 


Fig,  92.  Power  spectrum  of  a  carrier  modulated  in  frequency 
by  a  stationary  normal  process. 


In  the  case  of  narrow-band  frequency  modulation  m  « 1 ,  a  good  approximation  may 


be  obtained  if,  in  place  of  function  sin(x)- 
its  asymptotic  value  when  x  — 


z  JL 

x 


X. 

7T  X 

z 


in  (10.1  tto )  there  is  taken 


•so  ,  equal  to  —  .  Then  (compare  5o?) 


or 


AS  wm*  1 _ 

A  ’  2  Vm«  (u-tJ,,)1 

"♦"+  A* 


*aI 


019, 


r  ^ - ,  m  <  I. 


— )  +(«*— w,)* 


(10.142) 


Thus,  in  the  frequency  modulation  of  a  carrier  by  a  stationary  normal  process 
which  is  wide  in  comparison  to  the  effective  frequency  deviation,  the  power  spectrum 
of  the  modulated  carrier  has  the  same  form  as  the  spectrum  of  white  noise  at  the  out¬ 
put  of  a  linear  RC  circuit  (compare  p.  230).  The  bandwidth  of  this  spectrum  is  equal 


to  A*u=  1?  ra =  distinction  from  the  preceding  case,  in  which 


&tu 


the  ratio  •*— -  of  the  spectrum  band  of  the  modulated  carrier  to  the  band  of  the  modu¬ 


lating  process  depended  linearly  on  the  jsodulation  index  m,  in  the  present  case  this 
relationship  becomes  quadratic. 
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ChaDter  XI 


ELEMENTS  OF  INFORMATICS  THEORY 


1.  Probability- theory  methods  are  mathematical  research  methods,  adequate  to  a 


whole  series  of  radio  engineering  problems;  this  has  been  illustrated  by  numerous 


has  played  an  important  part  in  the  progress  of  radio  engineering  science  in  recent 


years. 


Along  with  the  successful  solving  of  specific  problems,  works  have  appeared  in 


which  the  oroblem  of  the  transmission  of  electrical  signals  is  stated  in  the  most 


general  terms.  The  generalized  statement,  based  or.  applied  practice,  of  the  problem 


of  the  effectiveness  and  reliability  of  electrical  communications  systems  has  become 


the  starting  point  for  a  branch  of  probability  theory  at  present  undergoing  vigorous 


development,  namely  information  theory. 


The  purpose  and  scope  of  the  present  took  do  not  permit  giving  an  at  all  satis- 


factofy  survey  of  the  present  state  of  information  theory.  Only  the  basic  concept 


will  be  set  forth,  and  some  general  results  will  be  formulated,  ir.  order  to  direct 


interest  in  the  studj.  of  :  t. 


the  message  sent  at  the  transmitting  end*. 


3y  message  is  meant  any  data  (information)  subject  to  transmission.  Such  in¬ 


formation  may  be  speech,  music,  an  image,  a  text,  a  photo,  codes,  telecontrol  ck 


if  at  the  receiving  end  the  content  of  the  message  is  known  fcr  certain  in  advance, 


then  there  is  no  sense  in  effecting  the  transmission  of  such  a  message. 


*  Here  is  meant  not  only  communication  in  the  customary  sense,  but  any  form  of 
transmission  of  useful  data  by  means  of  electrical  signals,  as,  for  instance,  radar, 
telsmetry,  automatic  control  systems ,  computing  machines,  etc. 
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examples  in  the  preceding  chapters.  The  application  and  development  of  these  methods 


the  attention  of  the  reader  to  the  chain  of  reasoning  of  this  theory  and  t  •  arouse  an 


2.  The  purpose  of  every  communication  system  is  to  restore  at  the  receiving  end 


mands,  etc.  In  information  theory  the  message  is  regarded  as  a  random  process,  since 


t  r  «-«L» 


12.  R.  G.  Kedhurst.  The  power  spectrum  of  a  carrier  frequency  modulated  by  gaussian  \ 
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The  device  producing  the  message  is  called  the  message  source  (or  information 
source).  Tne  statistical  structure  of  the  message  is  the  mathematical  characteristic 
of  the  message  source. 

Dy  discrete  source  is  meant  a  source  whose  product  is  a  random  process  with  dis¬ 
crete  time,  i.e.,  which  represents  a  sequence  of  random  variables  (cf.  Sect#  10,  Ch..I, 
and  also  Sect#  1,  Ch#  V).  An  example  of  a  discrete  source  is  a  device  transmitting 
letters  or  code. 

3y  continuous  source  is  meant  2  source  whose  product  is  a  continuous  random 
process.  An  example  of  a  continuous  source  is  a  device  transmitting  speech  or  music. 
In  the  general  case  the  product  of  a  continuous  source  may  be  a  random  function  of 
several  variables  as,  for  instance,  in  tbree-dl nensional  television,  where  besides 
depending  on  tine,  the  message  depends  also  on  three  spatial  coordinates.  Sy  means 
of  quantizing  a  continuous  message,  or  by  replacing  each  realization  of  the  message 
by  a  sequence  of  base  pulses  (cf.  Sect#  1,  Ch#V),  a  continuous  source  can  be  trans¬ 
formed  into  a  discrete  one. 

For  a  message  to  be  transmitted  by  means  of  a  radio-engineering  system,  it  must 
be  transformed  into  ar.  electrical  signal. 

An  aggregate  of  devices  along  which  signals  pass  is  called  a  channel.  The  con¬ 
cept  of  a  channel  embraces  all  the  technical  devices  which  transform  the  signal  jrL  r  to 
transmission,  effect  its  transmission  and  reception,  and  complete  the  transformation 
of  the  received  signal,  as  well  as  the  medium  used  for  transmitting  the  signal  from 
the  transmitter  to  the  receiver. 

If  to  a  given  signal  at  the  input  of  a  channel  there  always  corresponds  one  and 
the  same  signal  at  the  output  of  tiie  channel,  then  such  a  channel  is  called  an 
interference-free  channel.  In  an  interference-free  channel  the  signals  at  both  ends 
of  the  channel  are  linked  ty  a  definite  functional  relationship.  Thr  problem  of 
communication  in  this  case  is  reduced  to  the  identification  of  the  received  signal 
with  one  of  the  possible  realizations  of  the  message. 

Tne  presence  of  interference  (noise)  brings  about  an  irregularity  in  the 
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indicated  functional  relationship  between  the  message  sent  and  the  signal  received. 

In  the  same  manner  as  a  message,  interference  is  regarded  as  a  random  process. 
Therefore  cases  are  possible  when  various  signals  at  the  output  of  a  channel  will 
correspond  to  one  and  the  same  message,  and  conversely,  it  nay  be  possible  to 
identify  the  signal  received  with  several  possible  realizations  of  the  message. 

Both  the  source  and  the  channel  may  be  characterized  by  their  fine  statistical 
structure,  i.e,,  probability  distribution  functions  may  be  assigned  to  them.  For  the 
source  these  will  be  a  priori  distribution  functions  of  the  message  $  (t),  and  for  a 
channel  with  interference  they  will  be  a  posteriori  distribution  functions  of  the 
probability  of  obtaining  signal  7^  (t)  at  the  output,  under  the  conditio  that  message 
5  (t)  was  sent  (or  a  posteriori  distribution  functions  of  the  probability  that 
message  £  (t)  was  sent  if  signal  7^(t)  was  received).  However,  for  comparing 
various  sources  and  channels,  some  numerical  characteristics  of  these  distribution 
functions  are  used  in  information  theory. 

3.  Let  us  examine  a  discrete  message  source.  We  assume  that  the  number  of 
various  elements,  of  which  any  realization  of  the  message  may  be  composed,  is  finite. 
The  aggregate  of  these  elements,  x. ( i =  1,  2,  ...m)  is  called  the  alphabet  of  the 
source.  An  alphabet  may  be  an  aggregate  of  various  letters  of  a  given  language,  of 
code  symbols,  or  of  conve'vtianal  commands.  Any  realization  of  a  message  represents 
a  sequence  of  elements,  each  of  which  may  be  repeated  an  arbitrary  number  of  times. 

In  the  realization,  the  une  elements  will  thus  be  distinguished  by  the  place  they 
occupy  in  the  sequence.  Therefore  in  distinction  from  an  element  in  ar.  alphabet,  it 
is  expedient  to  introduce  a  separate  name  -  symbol  -  for  an  element  in  the  realiza¬ 
tion  of  a  message. 

Let  the  various  realizations  of  message  £  (t)  (t  =  tft,  t0  +1,...  t0  n  -  1) 
be  composed  of  r.  consecutive  symbols  and  let  P.  be  the  probability  of  the  appearance 
of  realization  (t).  Tne  number  of  various  realizations  consisting  of  n  symbols  is, 
with  the  given  alphabet  of  m  symbols,  obviously  equal  to  N  =  mn.  If  the  appearance 
of  each  realization  is  treated  as  a  separate  event,  then  the  aggregate  of  N  real- 
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izations  vrlll  comprise  a  complete  set  of  events  p ^  =  1 1 

The  amount -ln?j  is  (by  definition)  called  the  quantity  of  information  about 


event  £%*.  The  mean  quantity  of  information  for  one  realization  is  equal  to 

J 

H 


//.=-!]  w. 

/•i 

i.e.,  coincides  with  the  entropy  of  the  law  of  distribution  of  the  message  (cf.  Sect.  1 

Chapter  II).  Here  the  average  quantity  of  information  for  one  symbol  delivered  by 

the  source  is  equal  to  —  .  If  the  random  process  £  (t)  is  stationary,  then  there 

n 

exists  a  limit 


H  =  Hm  —  t 

n-* oo  it 


(11.?) 


which  depends  only  on  the  nature  of  the  source  and  is  called  the  entropy  of  the 
source. 

Let  there  be  known  the  average  number  K  of  the  symbols  delivered  by  the  source 
in  ?.  anil  of  tine.  Then  it  is  possible  to  introduce  also  the  entropy  of  the  source 
in  a  unit  of  time,  by  the  formula 


H'  =  MH. 


(11.3) 


The  magnitude  H* ,  bein^  the  mean  quantity  of  information  in  a  unit  of  time,  may  be 
called  the  speed  of  delivery  of  information  by  the  source. 

If  all  the  symbols  in  the  realizations  are  mutually  independent,  and  ,  p^,.... 
pm  are  the  a  priori  probabilities  of  appearance  of  the  elements  of  the  alphabet,  then 
with  a  s>  fficisntly  lar^e  n  the  probability  of  appearance  of  ary  realization  will  be 
equal  tr  . 


"I'm 


and,  consequently,  the  mean  quantity  of  information  for  one  realization  is 


Hm  =  -  In  P—  —  «  JJpJnp,. 


<- 1 


(11.4) 


The  source  entropy  is  in  this  case  equal  to 
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(11.5) 
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In  the  general  case  k  £  n  symbols  are  statistically  linked  by  a  k-dimensional 
distribution  law.  Such  a  group  of  symbols  is  called  a  k-gram.  Monograms  (k  =  1) 
are  symbols  themselves  in  case  they  are  mutually  independent.  Diagrams  are  groups 


of  two  symbols,  linked  by  the  two-dimensional  distribution  law  P^.  The  source 


entropy  for  one  diagram  is  equal  to 

m  m 

"<.*>=- EE ',v,n/v 


(11.6) 


I- 1  /-I 
.(2)  -  1, 


and  the  entropy  for  a  symbol  is  I!  =  Analogously  the  source  entropy  for  3 

k-gram  is 

m  « 

//(*)==~S  E  pix--‘k' 


1 1-» 


*■*-» 


(11.7) 


fv\  1 

and  the  entropy  for  a  symbol  is  H  '  =  r  H  . 

*>  (K) 


Bearing  in  mind  the  inequality  (2.120),  it  is  not  difficult  to  conclude  that 
H  '  ^  ^(1)  ar‘“  ana^°uously  ^  i'e,,  ta’Kinf  into  account  the  statistical 

interdependence  of  the  symbols  reduces  the  source  eftTropy . 

4.  The  simplest  discrete  source  is  one  which  delivers  sequences  of  symbols 
consisting  of  two  possible  elements.  An  example  of  this  is  a  source  of  telegraphic 
messages,  whose  alphabet  consists  of  two  elements;  "yes"  or  "no"  (cf.  Sect.  Ur  Ch.  I, 
and  also  Pig.  2).  If  all  the  symbols  are  mutually  independent,  then  the  probability 


of  the  appearance  of  any  one  of  N  =  2  realizations,  consisting  of  n  symbols,  will 

r  n-r 


be  equal  to  P  =  j>  ,  where  p  and  q  =  1  -  p  are  a  priori  probabilities  of  the 

appearance  of  each  of  two  possible  elements  and  r  is  any  whole  number  not  exceeding 

n.  However,  with  a  sufficiently  large  n,  r  a#  np  and,  consequently  the  mean  quantity 

of  information  for  one  realization  will  comprise 

•  //„==-  In  />  =  ~  In  (Py-r)  ^  ~  ‘in  (pny<)  = 

—  —  n  (P  In  p  -f  q  In  q), 

and  per  symbol  delivered 


H. 


H  *s=  -2-  *=  —  (p  In  p  -f  q  In  q). 

It 


(11.3) 
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The  quantity  II  in  (11.3)  does  rot  depend  on  n  and  represents  the  entropy  of  the 
telegraphic  message  source. 

For  the  data  of  the  example  in  $4,  Chapter  I,  p  =  ?("yes")  =  5/2,  q  =  ?(nrio")  = 
3/3,  the  source  entropy  is  equal  to  E  =  -(5/3  ln5/3  +  3/8  ln3/°)  =  0.£?  natural 
unit/symbol. 

5.  If  all  the  elements  of  the  alphabet  are  equiprobable,  then  with  a  suf¬ 
ficiently  large  n  all  K  realizations  of  the  message  will  also  be  equiprobable.  In 


that  case,  as  has  been  indicated  in  Sect.  11,  Ch.  II,  the  entropy  E^  is  at  its  Maximum 


and  is  equal  to  (on)nax  =  1>.N  =  n  In  m.  The  source  entropy  with  a  given  number  of  m 


elements  will  ir.  this  case  be  eoual  to  Sts  maximum  value  of  H  =  In  :n. 

max 


In  the  general  case  some  elements  will  be  more  probable,  and  others  less  so,  and 
the  same  property  will  be  possessed  by  the  realizations,  as  a  result  «■  f  which  Hf  ^T 


(K  )  .  With  a  given  E  it  would  have  been  possible  to  obtain  the  sane  amount  of 


n  max 

information  with  a  smaller  number  of  <  N  realizations,  if  they  had  all  been  equi¬ 
probable.  Therefore  the  quantity  H,  -His  called  interior  (or  exces:.-)  information, 

and  the  ratio 

H 


n  N max  ^  _  , 


H 

In  m  ‘ 


(11.9) 

is  called  the  coefficient  of  excess,  or  simpl.  vhe  excess,  of  th<_  source.  In  the  ex¬ 
ample  indicated  above  Kn  =  In  2  =  0.?  natural  unit/ symbol,  and  the  coefficient  of 

Obi 

excess  is  equal  to  Ru=  1  -  -j^sO.04 3. 

As  has  been  noted  above,  the  source  entropy  :.s  further  diminished,  and  conse¬ 
quently,  uhe  excess  is  further  increased,  if  between  the  symbols  or  groups  of  symbols 
there  exist  statistical  relationships.  Thus,  for  the  alphabet  of  the  English 


language,  consisting  of  twenty- six  letters,  the  maximum  entropy  is  equal  to  H 


max 


log-2(?  =  4.7  binary  units/symfcol*.  If  it  is  taken  into  account  that  the  letters  are 


not  equiprobable,  but  remain  independent  (monogram),  then  the  entropy  falls  to  4.14 


*  Cf.  footnote,  p.  82. 
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binary  units/symbol.  The  additional  consideration  of  the  statistical  structure  of 
the  language  yields  a  corresponding  reduction  of  the  entropy  to  3.56  binary  units/ 
symbol  (diagram)  and  3*3  binary-  units/symbol  (triogram).  If  account  is  ta'<en  of  the 
probability  of  the  appearance  of  individual  words  in  a  complete  sentence,  the  entropy 
falls  to  a  quantity  smaller  than  one  binary  unit  per  symbol,  which  corresponds  to  an 
excess  of  more  than  78jS. 

6,  Cne  of  the  general  results  of  information  theory  is  the  theorem  of  the  elimi¬ 
nation  of  excess  in  a  message  by  means  of  appropriate  coding.  py  coding  is  meant  any 


mutually  unique  transformation  of  the  realizations  £  •  of  message  £  (t)  into  the 

J 


reali zation  ^  of  another  message  (or  signal)  7^\ t) ,  i.e.,  from  the  mathematical  point 
of  view  coding  is  a  functional  transformation  of  the  message. 


It  is  clear  that  when  coding  with  utmost  brevity  the  more  frequently  encountered 
realizations  and  employing  longer  code  combinations  for  realizations  rarely  en¬ 
countered,  it  becomes  possible  for  us  to  reduce  the  average  number  of  symbols  in  the 

coded  realization  in  comparison  to  the  original  one.  Let  the  realization  £  • ,  con- 

¥ 


sisting  of  n  successive  symbols  and  having  a  probability  of  P.,  be  coded  into  the 

yj »  ^ 

realization  ?7  •,  consisting  of  n.  symbols.  The  ratio  may  be  regarded  as  the  co- 

j  ' 


efficient  of  compression  of  the  given  realization.  The  mean  statistical  value  of 


this  ratio  for  all  possible  realizations  q  .,  consisting  cf  n  symbols,  is  equal  to 

¥ 


"A 


(11.10) 


The  limit 


/-» 


P-limj*, 


(11.11) 


is  called  the  coefficient  of  compression  of  a  message  with  a  given  code. 

It  has  been  proven  (cf.  M).  that  if  the  entropy  of  a  message  is  equal  to  H, 


then  the  smallest  possible  value  of  the  coefficient  of  compression  is  equal  to  1  -  3  = 


H _ _ 


-  — - Employing  this  theorem,  it  is  possible  to  find  the  bottom  limit 

max  In 

to  the  compression  of  a  message  which  may  be  accomplished  by  means  of  an  optimum 


H 
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codification.  Thus,  in  the  above-indicated  example  of  the  telegraph  message,  the 
excess  is  extremely  small  and  the  possible  compression  cannot  exceed  5/«>  whereas  with 
a  ?8;£  excess  an  English  text  permits  a  compression  of  4.5  times. 

The  theorem  just  formulated  and  the  existing  methods  of  proving  it  establish  the 
possibility  of  a  compression  limit,  but  give  no  indications  as  to  how  the  optimum 
code  should  be  arrived  at.  With  the  practical  application  of  various  methods  of 
codification  for  compressing  a  message,  it  is  possible  on  the  basis  of  this  theorem 
to  evaluate  the  extent  to  which  the  method  employed  approaches  the  optimum. 

7.  We  pass  to  the  quantitative  character  of  a  channel.  The  connection  of  a 


source,  producing  the  messages  £*(j  =  1,  2,  ...N)  with  a  priori  prol  oilities  of 

J 


P(j),  to  a  channel  leads  to  the  appearance  at  the  output  of  the  channel  of  a  new 


source,  producing  the  signals  77^  (k  =  1,  2,  . ,.N)  with  the  a  posteriori  proba¬ 


bilities  P*(k).  If  at  the  input  of  the  channel  the  quantity  of  information  about  the 
J 

realization  £;  •  was  measured  by  the  quantity  -  In  P(j),  then  at  the  output  of  the 

J 

channel  the  quantity  of  information  about  this  realization  is  equal  to  -  In  F*K(j). 
Thus  the  quantity  of  information  about  the  realization  £  *  has  changed  in  the  channel 


P  ( *  1 

by  the  amount  -  In  P(j)  +  In  Pv (J )  =  In  — ^  ■  .  The  mean  quantity  cf  information 

K  P(J) 


for  one  realization  of  the  transmitted  message,  contained  in  the  signal  at  the  output 
of  the  channel,  is  equal  to* 


».(i.  tot 


PU) 


(11.12) 


*-*  ?(}  h) 

Substituting  by  the  rule  of  multiplication  P^j)  =  "  p^j  »  it  is  possible  to 


rewrite  (11.12)  in  a  form  symmetrical  with  respect  to  $  and 


,Y  S 


PU.  *) 


U)  P  (*)  * 


(11.13) 


If  the  interference  in  the  channel  is  so  strong  that  the  signal^  at  the  cutout 
of  the  channel  becomes  independent  of  the  transmitted  message^  ,  then  P(j,  k)  =  P(j) 
P(k),  and  from  (11.13)  it  follows  that  1^=  0,  i.e.,  such  a  channel  transmits  no 


*  The  curved  brackets {  j  indicate  not  a  function  of  the  random  variables  £  and  7?  , 
but  some  numerical  characteristic  linked  with  these  variables.  1 
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information  about  the  message  ^  .  Conversely,  for  a  channel  without  interference  it 
is  always  possible  uniquely  to  determine  the  transmitted  message  on  the  basis  of  the 


signal  received.  Therefore  for  a  channel  without  interference  p(j)  =  1  if  k  =  j , 


.  i 

and^is  equal  to  zero  with  k  sp  j.  Then  from  (11.12)  it  follows  that  In  {c,  ?}  = 
-S^(y)lnP(y)=^ JO,  jl.e.in  this  case  the  quantity  of  information  contained  in 

/•i  1 

signal  at  the  output  of  the  cha  iei ,  about  the  message  ,  is  equal  to  the  source 
entropy  H^,  or  to  the  quantity  of  information  about  £  contained  in  ^  itself. 

Introducing  conventional  entropies (Sect.  11,  Chapter  II),  it  is  not  difficult  to 
find  from  (11.13)  another  expression  for  the  mean  quantity  of  information 

N  N 

',{5,  4 = -£  £  p  m  pk  (j)  in  p  „{j)  - 


*-i  /- 1 


N  N 


02' 


-£S'>(/.‘)'»PW  =  -S'>««„(E)-SPU)lnP(A 

*-*/-» 


*-I 


/-> 


'.(E.  n)=H. 


(11. 11*) 


wr.ere 


(n.15) 


is  the  average  (for  all  possible  instances  of  k)  value  of  the  a  posteriori  entropy 


of  the  message. 


The  quantity  Hn  ^  }  shows  how  great  the  mean  indeterminacy  fcr  one  real¬ 

ization  is,  in  determining  the  transmitted  message  on  the  basis  of  the  signal  re¬ 
ceived  after  transmission  over  a  channel  with  interference.  This  quantity,  called 
uncertainty,  is  an  important  characteristic  of  interference  in  a  channel.  For* a  chan¬ 


nel  without  interference  *  0  ,  i.e.,  the  uncertainty  is  equal  to  zero.  This 


signifies  that  between  the  possible  realizations  of  the  signal  and  the  message  there 
exists  a  functional  congruence.  Therefore,  for  instance,  coding  may  be  regarded  as 
transmission  along  a  channel  without  interference. 

If  the  soui'ce  at  the  input  of  a  channel  is  stationary  and  source  resulting  from 
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entropy  per  symbol,  we  obtain  the  mean  increment  of  information  per  unit  of  time 


which  characteri7.es  the  speed  of  transmission  of  information  over  a  channel  from  a 
given  source. 


The  full  symmetry  of  (11.13)  with  respect  to  £  and  ^  makes  it  possible  to  repre¬ 


sent  the  mean  quantity  of  information  per  symbol  in  the  form  of 

/{?.  T,}  =  W{t,}-//:{4-  . .  (11-12) 

where  K  } -is  the  a  priori  source  entropy  at  the  output  of  the  channel, 

-is  the  average  value,  for  ail  possible  message  realizations,  of  the  a 


posteriori  entropy  of  the  signal  at  the  output  of  the  channel. 

3.  For  an  illustration  of  the  introduced  concept  let  us  turn  again  to  the  ex¬ 
ample  in  Sect*  ii,  Ch*  I.  At  the  input  of  the  channel  there  enter  symbol  sequences 
consisting  of  "yes"  or  "no"  elements,  the  a  priori  probabilities  of  which  are  P("yes") 
=  5/8  and  P("no")  =  3/2.  At  the  output  of  the  channel  symbol  sequences  are  observed 
which  also  consist  of  two  possible  elements:  "green"  and  "red",  the  a  priori  proba¬ 
bilities  of  which  are  equal  to  each  other  P("green")  =  P("red")  =  f .  The  a  posteriori 
probabilities  of  the  transmission  of  message  elements  in  the  reception  of  a  signal 
element  are  equal  to 

P"green"  ("yes")  =  3/4,  P"green"  ("no")*$ 

P"red"  ("yes")  =  },  P"red"  ("r.o")  =  \ 


F-TS-^ll/y  kyj 

«-  Ak'. /t* a aha  s\ tJij Ll V > 


.  "nail «  rajjjfjE 


I 


§»^< 

m* 


Mr 


BriVv 

§$/> 


m. 


m 


Jiff; 

t. 


sfex 


Pi 

&/' 

m 


B& 


W 


5'  1 

k  ; 


te> 


I? 


I 


m- 


\{j 


"JW 


'k-*A 


The  amount  of  unreliability  per  symbol  is  equal  to 

',,(i>=-7(fl"7  +  Tl"T)-T(7l"T  +  iln?)  = 

=0.63  natural  unit/ symbol 

The  entropy  of  the  source  under  examination  has  above  been  found  equal  to 
H{«>  -0  .6?  natural  unit/symbol.  Then  on  the  basis  of  formula  (11.1^)  we  find 
the  mean  quantity  of  information  obtained  for  one  symbol  at  the  output  of  the  channel 
I  =  0.6?  -  O.63  =  0.04  natural  unit/ symbol. 

9.  By  the  carrying  capacity  of  a  channel  is  meant  the  maximum  possible  speed  cf 
transmission  of  information 

c=c  a  iii. 


! 


I 


The  maximum  is  taken  on  the  basis  of  all  the  possible  message  sources  which  may 
transmit  signals  over  the  channel.  This  quantity  must  depend  only  on  the  channel 
properties  and  is  the  most  important  characteristic  of  the  channel. 


For  a  channel  without  interference  the  unreliability  H  {$}  -  0  ,  and  then 


=  H< 


max 


Since  the  coding  of  a  message  may  be  regarded  as  its  transmission  over  a  channel  with¬ 
out  interference,  it  therefore  follows  from  the  theorem  on  message  compression  (cf.  6 
above)  that  by  means  of  appropriate  coding  it  is  possible  to  bring  the  source  entropy 
to  a  maximum,  equal  to  the  carrying  capacity  cf  the  channel. 

10.  A  most  important  result  of  information  theory  is  Shannon's  Theorem  on  the 
optimum  utilization  of  channels  with  interference  by  means  of  appropriate  coding  of 
the  transmitted  message. 

The  difference  should  immediately  be  emphasized  between  coding  in  a  channel  with¬ 
out  interference  for  maximum  message  compression,  and  coding  in  a  channel  with  inter¬ 
ference  with  the  purpose  of  combatting  interference.  In  the  first  case  the  coding  is 
directed  at  removal  of  the  excess  present  in  the  message,  while  in  a  channel  with 
interference  transmission  with  excess  symbols  is  a  reliable  means  of  reducing  mis¬ 
takes.  The  simplest  (but  not  the  best)  method  of  introducing  excess  is  multiple 
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repetition.  In  an  ordinary  text,  due  to  the  high  excess,  errors  in  the  transmission 
of  individual  letters  are  easily  corrected  on  the  basis  of  meaning. 


It  could  be  expected  that  as  the  requirements  of  transmission  reliability  are 
increased,  the  transmission  speed  should  approach  zero.  Shannon  has  shown  that,  in 
actual  fact,  the  carrying  capacity  of  a  channel  has  a  fully  determined  value,  dif¬ 
ferent  from  zero,  no  matter  how  low  the  error  frequency  may  be.  In  Shannon’s 
Theorem  two  quantities  are  employed  in  evaluat.  lg  the  interference-proof  features 
of  a  channel  -  the  probability  of  error,  and  unreliability  (i.e.,  the  mean  value  of  ; 
the  a  posteriori  message  entropy).  Therefore,  as  has  been  justly  pointed  out  by  ■ 

A.  Ya.  Khinchin  [  *  ]  ,  it  is  preferable  to  speak  of  two  theorems,  without  uniting  j 

them  under  a  common  heading.  $ 

1 

Theorem  I.  Let  C  be  the  carryin-:  capacity  the  channel,  and  K*  <  C  be  the  i 

| 

rate  of  production  of  information  by  the  source,  and  let  £  >  0  be  of  any  desired  1 

degree  of  smallness.  It  is  possible  to  code  the  output  of  the  source  £  (t)  into  a  ] 

t  1 

signal  $  (t)  in  such  a  manner,  that  each  realization  :  of  the  message,  consisting  J 

a  l 

of  a  sufficiently  large  number  of  n  symbols,  will  turn  into  realization  •  of  the  sj 

f 

signal  of  n  +  n  symbols  and  that,  in  transmitting  the  signal  over  the  channel,  it  f 

p 

is  possible  upon  its  realization  at  the  output,  with  a  probability  exceeding  1-6 
correctly  to  determine  the  message  sent.  | 

Theorem  II*.  Let  C  be  the  carrying  capacity  of  the  channel,  and  K*  <  C  be  the  | 

rate  of  production  of  information  by  the  channel.  It  is  possible  so  to  code  the  out-  \ 

put  of  the  source  that  the  rate  of  information  transmission  I*  would  be  as  close  as  f 

X 

desired  to  H’ ,  i.e.,  to  the  rate  of  the  production  of  this  information  by  the  source.  jj 
In  view  of  (11.17)  this  indicates  the  possibility  of  transmitting  a  message  over  the  jj 
channel  with  as  little  unreliability  as  may  be  desired. 

It  should  be  noted  again  that,  as  also  in  the  caso  of  the  theorem  on  message 
compression,  the  cited  theorems  indicate  only  the  possibility  of  optimum  coding,  but 


1 


*  As  has  been  shown  in  P-tf,  the  second  theorem  may  be  obtained  as  a  consequence  * 
of  the  first.  ; 
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not  the  means  of  its  practical  realization.  These  theorems  are  of  the  nature  of 
limit  theorems  (as  are  also  Iyapunov's  theorem  and  the  law  of  large  numbers).  The 
following  problem  of  practical  significance  is  to  find  convenient  approximations  to 
the  limit  relationships,  as  has  already  been  done  for  the  central  limit  theorem  and 
in  error  theory  for  the  law  of  large  numbers  (cf.  Chapter  IV)* 

11.  In  order  to  emphasize  the  general  nature  of  information  theory,  it  may  be 
pointed  out  that  from  the  point  of  view  of  this  theory,  it  is  also  possible  to  ex¬ 
amine  problems  dealing  with  the  reliability  of  systems  consisting  of  a  large  number 
of  elements  (the  simplest  of  which,  cf.  inSect*  4,  Ch,  I).  Th°re  is  a  complete 
analogy  between  the  concepts  of  "message"  and  "systems",  "message  symbol”  and  "system 
elements",  between  a  statistical  description  of  an  interruption  in  the  functioning  of 
a  system  element  and  a  statistical  description  of  a  channel  with  interference.  A 
system  consisting  only  of  elements  in  series  is  analogous  to  a  message  entirely  lack¬ 
ing  in  excess  symbols.  Reservation,  i.e.,  the  introduction  of  excess  elements  in  a 
system  which  functions  in  parallel,  is  the  most  effective  method  of  increasing  its 


reliability.  This,  however,  leads  to  an  increase  of  the  physical  volume  of  the  equip- I 


ment  and  of  its  cost,  which  in  a  certain  sense  is  equivalent  to  decreasing  the  anoun 


*  •? 


of  information  for  one  symbol.  It  would  apparently  make  definite  sense  to  formulate 
problems  of  system  reliability  mathematically  in  the  same  form  as  problems  in  message 
transmission,  and  to  apply  to  this  case  the  general  theorems  of  information  theory.  ;j 

12.  The  concept  of  the  quantity  of  information  in  transmission  over  a  channel  *-j 

) 

is  generalized  for  the  case  of  continuous  sources.  Referring  the  reader  to  works  M.J 


B1*].  to!  for  general  and  rigorous  generalizations,  we  shall  restrict  ourselves  to 
the  simplest  ones. 

The  probability  of  an  event,  consisting  in  the  fact  that  the  values  of  the 
continuous  message  (t)  are  located  on  the  interval  of  (x,  x  +  dx),  is  equal  to  w^ 
(x)  dx,  and  the  probability  of  the  same  event,  under  the  condition  that  at  the  output 
of  the  channel  the  signal  7^  ( t)  is  observed,  is  equal  to  w(x/y)dx.  The  increment  in 
the  amount  of  information  is  equal  to  In  mWjlL  .  The  mean  quantity  of  information 
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with  respect  to  message  £  (t),  contained  in  signal  ^(t),  is  equal 

?  *° 

1  (t*  ’ll  *  j  »u(y)  f  w(xly)ln*£&Ldxdy, 

*<•  *  <H» 


to 


or 


Oo  00 


dxdy. 

(11.20) 

dxdy. 

(11.21) 

— Oo  — eo 


Analogously  to  the  manner  in  which  (11J.4)  was  obtained  from  (11.13)*  from  formula 
(11.21)  with  consideration  of  (2.116)  we  obtain 


0  ') 


w 

Mi,  *)}=-  j  tt'nWInffinW^-l- 

—GO 

4 -]wl2(y)Hxlydy  =  H{Z)-fIr{l}, 

— oo 

where  H  15}  is  the  a  priori  entropy  of  message  ^(t),  and  15)  is  the  mean  value 
of  the  a  posteriori  entropy  of  message  Ef  (t),  under  the  condition  that  signal  7^  (t) 


was  received. 


The  quantity  H^^)  retains  the  designation  of  unreliability. 


The  full  symmetry  of  (11.21)  with  respect  to  x  and  y  makes  it  possible  also  to 


write 


w 

t  {i,  n}  =  —  j  tt,i2(y)ln©,i2(y)rfy4- 

—oo 

4-  j  w,t  (x)  Htlxdx  =  H  {r,}  —  //.  {rj} . 


(11.23) 


For  channels  with  a  limited  transmission  band  it  is  possible  also  to  introduce 
the  concept  of  rate-  I*  of  information  transmission,  if  I  is  multiplied  by  the  number 
of  data  (excerpts)  M  per  unit  of  time  by  which  are  determined  those  signals  whose 
spectrum  occupies  the  limited  frequency  band.  This  number  M  is  determined  on  the 
basis  of  the  well-known  Kotelnikov* s  theorem  (cf.  Footnote,  p.  186)  and  is  equal  to 
M  =  2F  data/sec,  where  f  is  the  highest  frequency  in  the  signal  spectrum.  Thus 

/*  {«,  tj)  =  2F7  t)}.  (11.24) 

It  should,  however,  be  kept  in  mind  that  between  the  discrete  and  continuous 
cases  there  are  a  number  of  substantial  differences.  Thus,  for  instance,  functional 
transformations  of  symbol  sequences  car.  change  their  length,  but  do  not  change  the 
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If 


probability  of  emergence  and,  consequently,  the  entropy  for  one  realization.  The 
functional  transformation  of  a  continuous  message  changes  the  probability  distri¬ 
bution  function  and  with  it  the  entropy  of' the- message.  If  H  J  is  the  en-  • 
tropy  of  message  £  (t),  then,  employing  (2.114)  and  (3.1 1).  it  is  not  difficult  to 
write  the  entropy  of  signal  7}  (t) 

I  ff  fa }=//{«}—  J  ...  jwlt(xh...xn)lnp\dxl...dxn,  V  ' 

*  ‘  —Oo  —00  ' 

where  wn(x^,*.«xn)  is  the  n-dimensional  distribution  function  of  ^  (t),  and  D  is  the 


transformation  jacobian  of  the  variables  x.  to  the  variables  y.  =  f(x. ,...x  ). 

i  i  1  n 


Only  in  transformations  for  which  Jd  |  =1  (for  instance,  the  addition  of  4r  (t) 
with  an  arbi-traay determined  function  of  time)  does  the  entropy  retain  its  value. 

Thus,  in  effecting  functional  transformations  on  continuous  messages,  it  is  possible 
by  means  of  changing  the  distribution  function  ("redistribution"  of  the  probabilities) 
to  attain  the  desired  change  in  entropy. 

13*  bet  us  assume  that  the  transmitted  message  £  and  the  interference  acting 
in  the  channel  £  are  independent  random  processes,  and  let  w^(z)  be  the  distribution 
function  of  the  interference.  Since  the  signal  at  the  outpiit-of.  the  channel  is 
-  Bf  +  Cf  »  therefore 

w(y/x)  =  w^(y  -  x) 


and 


or 


oo  oo 

ff\  W  =ml  /  f  tt>u(je)  J  w  (yjx)  In  w(y/x)dydxj  = 

HO  -00 

«•  0» 

= m,  {  J  t»„  (x)  j  a/,3  (y —  jc)  In  wn  (y  —  x)  dydx  }  = 
—00  —00 

00 

=  Jwij(2)  In  Wx  J  (z)dz, 

-HJO 

^h}=//{q, 


(11.25) 


i.e.,  the  mean  value  of  the  a  posteriori  entropy  of  the  received  signal^  ,  under  the 
condition  that  message^  was  sent,  is  equal  to  the  entropy  cf  the  interference. 
Substituting  (11.25)  into  (11.23),  we  obtain 
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«* 


/u,ti)= Hiri  -h[:). 


(si 


Since  H  i  C,Jdoes  not  depend  or.  the  message  source,  the  maximum  value  of 
is  attained  at  the  maximum  of  entropy  H  IV  of  the  received  signal.  Therefore, 
taking  into  account  (11.  I*?)  and  (11.24),  it  is  possible  in  the  case  under  examination  \ 
to  compute  the  carrying  capacity  of  a  channel,  wherein  the  slcr.al-and-interference 
band  is  limited  by  a  maximum  frequency  F,  by  moans  of  the  formula 


C=2F[HnaxU)-H{r)]. 


(11.27) 


Let  us  suppose  that  the  interference  is  distributed  according  to  the  normal  law 


with  a  dispersion  of  O'  ,  and  let  us  assume  that  the  mean  powers  of  the  transmitted 


signals  are  limited  by  the  quantity  O' 


In  view  of  the  independence  of  the  interference  and  signals,  the  mean  powers  of 

*■  x 

the  signals  received  are  limited  by  the  quantity  O'  O'  .  As  has  already  beer. 

£  It 

noted  in  |1 1.,  Chapter  II,  a  continuous  random  variable  with  a  limited  dispersion  has  ~ 
maximum  entropy  if  it  is  distributed  normally.  With  respect  to  the  problem  at  hand, 
this  signifies  that  the  rate  of  information  transmission  in  the  channel  will  be  at 
its  maximum  if  the  signals  at  its  output  are  normally  distributed.  Since  the  inter¬ 
ference  is  independent  of  the  signals  and  is  also  normal,  the  lattar  is  equivalent 
to  a  requirement  for  a  normal  distribution  of  the  transmitted  signals. 


According  to  (2.1'3)  the  entrop;.  of  a  normally  distributed  signal  with  a  dis- 


Z  Z 

persion  of  O'  +  <y  is  equal  to 


Hmax  (n)  —  -J-  In  [2m;  (o*  -f  3* )], 
and  the  entropy  of  the  interference  is 

#  U=4-1n(2*w’). 

Therefore  in  accordance  with  (11.27)  the  carrying  capacity  of  a  channel  with  band  F, 


in  which  there  acts  a  normally-distributed  interference  with  a  mean  power  of  O'  , 


rr 


is  equal  (with  a  mean  power  of  the  transmitted  signals  of  GT  )  to 
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C=F|n-^PL  =  Fln 


(,+4> . 


(11.23) 


It  can  be  seen  f non  (11.23),  that  if  the  interference  4*  is  weak  (o^,^  )p 
then  the  quantity  cf  information  about  ^ ,  when  7^  =  ^  is  known,  is  great 

and  becomes  unlimited  when  O^- - »  0  . 

Conversely,  the  quantity  of  information  rapidly  diminishes  with  an  increase  in 
the  interference  dispersion.  It  also  follows  from  this  formula  that  with  a  decrease 


in  the  signal/interference  ratio 


OjL 

O'TT 


,  it  is  possible  to  preserve  the  carrying 


capacity  of  the  channel  by  widening  its  band  ?  and,  conversely,  it  is  possible  to 
narrow  band  F  at  the  cost  of  increasing  the  signal/interference  ratio. 

Employing  Shannon's  Theorem  (10,  above)  it  is  possible  to  assert  further  that 
with  appropriate  coding  of  the  message  it  will  be  possible  to  transmit  signals  with 
as  small  a  probability  of  error  as  desired  if  only  the  rate  of  transmission  over  the 
channel  does  not  exceed  its  carrying  capacity,  which  is  determined  by  formula  (11.28). 
To  attain  the  maximum  transmission  rate  the  message  must  be  coded  in  such  a  manner 
that  the  transmitted  signals  have  a  normal  law  of  distribution. 

14.  The  general  aspect  of  information  theory  makes  it  possible  to  specify  the 
following  groups  of  problems,  which  are  of  importance  in  setting  up  or  analyzing  any 
communications  system*. 

1)  Optimum  coding  of  the  transmitted  message  into  a  signal  possessing  minimum 
excess.  The  elimination  of  excess  is  attained  by  limitation,  by  the  employment  of  a 
priori  information  (such  as  the  data  of  the  system  itself  or  the  shape  and  parameters 
of  t.he  signals  employed),  and  also  by  means  of  the  elimination  of  statistical  inter¬ 
relationships  in  the  message  (decorrelation).  A  whole  series  of  decorrelation 
methods  is  known:  consolidation  (codes  v.  -h  a  lag),  linear  prediction,  dynamic  codes, 
3pectral  codfes  (emphasis  of  individual  frequencies),  spectrum  compression,  etc.. 


*  '  Cf .  footnote  p.  4 


:.A  .  - 


F-TS-?Sll/V  442 


442 


■y&pVV'V, 


P 


/*f 

.  O- 


!<l,?^^'ywyira'>;:w^ " ^yrv  c ;•■« <sa 


I 


The  reduction  of  excess  increases  the  efficiency  of  a  system,  but  lowers  its 
reliability.  A  second  group  of  problems  arises. 

2)  Optimum  coding  of  the  transmitted  signal  to  provide  the  most  interference- 

p:‘oof  transmission  of  this  signal  over  a  channel  with  noise.  Here  belong,  above  all,  3 

* 

various  methods  of  modulation  in  wide-band  systems  (frequency,  pulse,  code,  etc.). 


m 


3)  The  third  group  of  problems  is  linked  with  the  question  of  the  practical 


M 


possibility  of  extracting  the  useful  information  contained  in  the  signal  at  the  out-  M 


put  of  a  channel,  i.e.,  with  the  possibility  of  separating  the  transmitted  signal 


§ 


from  interference.  The  indicated  possibility  is  realized  by  various  methods  of  sepa— 


rating  the  signal  out  at  the  receiving  end:  amplitude  limitation,  frequency  (optimum; 


filters,  comb  filters)  and  time  methods  (storage,  correlational  reception).  These 


are  joined  by  methods  of  error  detection  in  the  received  signal  and  of  the  automatic  -gj 
correction  of  these  errors  by  means  of  corrective  codes. 


15.  In  connection  with  problems  of  reception,  considerable  interest  is  afforded-,^ 
by  the  following  problem.  It  is  possible,  according  to  Shannon's  Theorem,  so  to  code; ’J 
a  message  into  a  signal  transmitted  over  a  channel  with  interference,  that  on  the 
,  basis  of  the  received  signal  it  will  be  possible  to  determine  the  transmitted  ness age; jl 
with  as  small  a  probability  of  error  as  desired,  so  long  as  the  rate  of  information  J 
transmission  does  not  exceed  the  carrying  capacity  of. the  channel.  However,  in  a 

% 

number  of  cases  the  communication  .system  is  given,  and  there  is  no  possibility  of  if 

4 

arbitrarily  coding  the  transmitted  message.  Let  us  therefore  assume  that  the  sta¬ 
tistical  characteristics  of  the  transmitted  signal  and  of  the  interference  in  the 
channel  are  given.  What  in  such  a  case  is  the  optimum  method  of  reception,  and  what  ^ 
are  those  minimum  probabilities  of  error  in  the  determination  of  the  transmitted 
signal  on  the  basis  of  the  received  one  which  may  be  attained  by  means  of  receiver 
improvement? 

This  problem  was  formulated  and  solved  by  V.  A.  Kotel'knikov  [2]  .  We  shall 
pause  briefly  on  the  basic  idea  of  the  cited  work,  restricting  ourselves  to  the 
simplest  case  of  the  transmission  of  a  discrete  signal,  any  of  whose  N  realizations 
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consists  of  a  sequence  of  n  symbols. 


Each  of  the  symbols  of  the  sequence  may  be  treated  as  a  coordinate  of  a  given 
realization  of  the  transmitted  signal  in  a  space  of  n  dimensions.  Then  to  each 
realization  there  corresponds  a  point  in  the  n-dimensional  space,  and  to  the  aggre¬ 
gate  of  all  the  possible  realizations  of  the  transmitted  signal  there  correspond  K 
various  points  a.,  a.,  ...a„  of  this  space.  At  the  output  of  the  channel  the  real- 

i  2  N 

izations  of  the  signal. will  also  represent  sequences  of  n  symbols,  to  which  will 
correspond  N  points  of  the  space  x^ ,  The  points  in  space  corresponding  to 

the  signal  at  the  channel  output  will  not,  however,  coincide  with  the  points  cor¬ 
responding  to  the  transmitted  signal,  and  between  the  points  a^  and  there  is  not, 
due  to  the  random  character  of  the  interference,  even  a  functional  relationship.  The 

problem  of  reception  lies  in  restoring  the  transmitted  signal  a.  on  the  basis  of  the 

J 

received  signal,  i.e.,  on  the  basis  of  point  x^. 

Let  us  break  down  the  entire  space  of  n  dimensions  into  N  non-overlapping 
regions  G^(i  —1,  2,  ...N)  and  let  us  consider  that  if  the  received  signal  has 
fallen  into  a  region  Ch ,  then  the  signal  has  been  transmitted  (compare  with  Sect.5 
Chapter  VIII).  With  some  probabilities  the  point  may  fall  into  any  of  N  regions. 
In  case  this  point  corresponds  to  the  transmitted  signal  and  does  not  fall  into 
a  region  0^,  the  receiver  erroneously  reproduces  a  signal  different  from  a*.  De¬ 
pending  on  the  configurations  of  the  regions  G,  the  probabilities  of  error  will  be 
greater  or  less.  It  is  possible  to  formulate  the  problem  of  determining  an  optimum 
breakdown  of  the  signal  space  into  the  regions  G^(  i  —  1,  2,  ...N),  for  which  the 
probability  of  the  correct  reproduction  of  the  sent  signal  is  the  maximum  one.  A 
receiver  which  effects  an  optimum  breakdown  of  the  space,  and  which  yields  the  mini¬ 
mum  number  of  incorrectly  reproduced  signals,  is  called  an  ideal  one  according  to 
Kotel’nikov.  the  interference-resistant  quality  of  an  ideal  receiver,  attainable  as 
a  limit  for  given  statistical  characteristics  of  signal  and  interference,  is  called 
the  potential  interference-resistant  quality. 

In  the  simplest  case,  when  all  the  realizations  of  a  signal  are  equiprobable, 
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the  optimum  breakdown  of  the  space  is  one  in  which  any  point  x  of  the  space  refers 
to  a  region  0^  of  that  signal,  to  whose  representational  point  a  the  given  point  is 
closest  of  all.  This  same  rule  for  the  construction  of  an  ideal  receiver  is  also 
retained  for  nonequiprobable  realizations  of  a  signal,  but  under  the  condition  that 
the  intensity  of  the  interference  be  sufficiently  low. 
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Appendix  IV 


The  Delta-Function 


By  definition  the  delta-function  &  (t  -  t0)  for  any  real  parameter  tQ  is  equal 
to  2ero  when  tf  tQ  and  is  unlimited  when  t  =  t 

*«-'•>={»,  /=/,.  (1) 

The  integral  of  this  function  within  the  limits  of  -  c®to  +  oo  is  equal  to  unity 

]  l{t—t0)dts=l.  (2) 

—m 

Strictly  speaking,  the  delta-function  is  obtained  as  the  limiting  one  of  a 
single-parameter  set  of  functions.  Many  examples  of  such  sets  of  curves  can  he 
pointed  out.  One  such  set,  as  has  been  pointed  out  in  Sect.  3>  Ch.  II,  is  the  set  of 
normal  distribution  functions  with  a  constant  average  value  of  a  and  with  a  variable 
mean-square  <T. 

Another  example  is  the  set  of  functions 

y  (*•  *)  +7)  ’ 

from  which  vhenX->oOwe  obtain  a  delta-function.  As  a  third  example  let  us  examine 
the  aggregate  e(t,  Z)  of  square  pulses  of  unit  area,  whose  duration  is  Z  ,  and  whose 
height  is  1  /c 

/</#. 


T  l0*  '< 


(3) 


If  the  duration  of  the  pulse  is  caused  to  approach  sero,  then  as  a  result  of  such  a 
limit  transition  we  obtain  the  delta-function 


•  *(*—*•) **  Hme(/,*). 


(4) 


The  convolute  of  a  delta-function  with  any  limited,  and  continuous  at  the  point 


tfl,  function  f(t)  has  the  following  remarkable  property 


(5) 
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The  property  expressed  by  formula  (5)  may  be  called  the  filtering  property  of  a 
delta-function.  A  delta-function  actually  acts  as  a  filter;  multiplying  an  arbi¬ 
trary  function  f(t)  by  &(t-tc)  and  integrating  with  respect  tc  t,  we  isolate  one 
value  of  this  function  f(tQ),  i.e.,  that  value  which  corresponds  to  zero  of  the  argu¬ 
ment  of  the  delta-function  t  -t  Q*  0.  Let  us  note  that  in  the  filtering  integral  of 
(5)  the  integration  limits  of  -  and  ♦o’  may  be  replaced  by  any  pair  of  finite  num¬ 

bers  a  and  b,  if  only  the  point  t  *  t0  lies  within  the  interval  (a,  fc).  The  proof  of 
formula  (5)  is  obtained,  if  under  the  integral  sign  in  place  of  £  (t  -t^)  there  is 
placed  any  function  approximating  it  and  then  a  limit  is  taken  (Fig.  93). 


Fig.  V-  Filtering  property  of  a  delta-function- 
Let  us  find  the  spectrum  (Fourier  transformation)  of  a  delta-function,  em¬ 
ploying  the  filtering  property,  we  obtain 

J  (6) 

If  t0  =  0,  then  from  (6)  1:  fellows  that  the  spect.-um  of  £  (t)  is  uniform  at  all 
frequencies,  with  an  intensity  equal  w  unity.  The  spectrum  of  the  half  sum  of  two 
delta-functions  yl»(*K)  +  *(*-#•)]  -r‘  accordance  with  (S).  equal  to 

y(e  cos**/,. 

Performing  now  an  inverse  Fourier  transformation,  we  find 

•  m . 

jj  |  (?) 

jg  J  eM COS •Jdm  J COS •/ CQtmJd*  =  ~  ^  J 

In  virtue  of  the  symmetry  of  the  Fourier  integral,  the  variables  t  and  <0  in  formulas 


F-TS-^t  1/7 


'4  C&&ZH2  » ■inn  i , 


1 


(  ) 


(6)  and  (?)  may  exchange  places. 

The  derivatives  of  a  delta-function  art  defined  a s  limits  of  the  corresponding 
derivatives  of  the  approximating  functions.  Thus,  for  instance,  If  for  such  an  ap¬ 
proximation  there  are  employed  normal  distribution  functions  when  <F  — >  0,  then  for 
the  n-th  derivative  of  the  delta-function  we  obtain  the  following  definition 

(8) 


lim)  (0 = Hm  f  -if*  £  e"  1 . 

w  #->8  l  Yto'di*  ) 

Just  as  for  the  delta-function  itself,  its  derivatives  are  equal  to  zero  when  tft  0. 
The  behaviour  of  the  derivatives  when  t  =  0  is  complex.  Thus,  for  instance,  the 
first  derivative  of  the  delta-function 

is  equal  to  -too  when  the  origin  of  the  coordinates  is  approached  from  the  left 
(t  =  0")  and  is  equal  to  -OOat  when  the  origin  is  approached  from  the  right  (t  =  0  ). 
In  the  vicinity  of  t  =  0  the  behavior  of  (t)  is  comparable  with  the  behavior  of 
the  function  -  l/t. 

The  filtering  property  of  the  delta- function  extends  also  to  its  derivatives. 

The  convolut*  of  the  n-th  order  derivative  of  a  delta-function  with  any  function 


which  has  a  continuous  n-th-order  derivative  at  the  point  tQt  is  equal  to 


(9) 


If  the  derivative  f^(t)  undergoes  an  interruption  at  the  point  tQ,  then 

f(t)  (t  -tjdt=  f<">('B+0)24-/W(/t~-) .  (g» ) 


f 


Let  us  find  the  spectrum  (Fourier  transformation)  of  the  derivative  of  a  delta- 
function.  Employing  h) ,  we  obtain 


(10) 


If  tQ  =  0,  then  from  (10)  it  follows  that  the  spectium  of  (t)  is  equal  to 


(  -iu))n. 
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Appendix  V 


Computation  of  the  Integral  K 


vrnere 


Mf 


fY^'W 


+  2  a„xy  +  +2a„x+ 2aMy  -f  aM 


is  the  positively  determined  quadratic  form. 


Expression  (2)  represents  the  equation  of  a  second-order  surface  -  an  ellipsoid 


By  rotation  of  the  axes  and  translatior  of  the  origin  of  the  coordinates  it  is  pos¬ 


sible  to  reduce  this  equation  to  the  canonical  form 


♦  (u,u)  ss  AjU*  -f  4"  Ci 


which,  besides  the  free  term,  contains  only  the  squares  of  the  variables  u  and  v. 


With  such  a  substitution  of  the  variables,  integral  (1)  is  reduced  to  the  form 


K=  C  l  e  *  D  dudv, 

— »  —a* 


where  D  is  a  transformation  jacobian.  Since  the  transformation  of  the  coordinates 


amounts  only  to  a  translation  of  the  origin  and  a  rotation  of  the  axes,  D  =  1 .  There 


«  a* 

H  l 


~y  <*.••+ *.**+C> 


dudv  = 


C  a*  X(a* 


’■t  *  j  e  *  du  j  e 


Since 


a*  W 


J'" ’*“/?• 


X—  ^  * 


Thus,  the  computation  of  integral  (1)  has  been  reduced  to  finding  the  quantities 
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‘narf  ir^-rr?^--,-  '■•TP'r'***.  «^r^i 

■* - r  ... 


Ax,  »  arid  C.  In  the  theory  of  quadratic  forms,  it  is  proved  thatX^  and 
are  roots  of  the  characteristic  equation 


i*-/,i+/2= 0, 


(5) 


the  coefficients  of  which  are  expressed  in  terms  of  the  coefficients  of  the  quadratic 
form  (2) 

/i=«h+<*m.  —  a\v  (6) 


and  the  constant  C  is  found  on  the  basis  of  the  form 


r _ 

C~Tt> 


(7) 


where 


/,= 


an  °u  flu 
au  fl«  ai* 
au  fljj  a3| 


(3) 


Into  formula  (4)  there  enters  only  the  product  A.2  of  the  roots  of  equation  (5), 


equal  to  the  free  term  I2.  Therefore  the  desired  integral  is  equal  to 

.K=^e~2^.  (9) 


FT,' 


Let  us  employ  formula  (9)  for  computing  02  (  ,  v2 )  in  £9,  Chapter  III.  Effecting 


X2  —  So 

first  a  substitution  of  the  integration  variables  x  =  —  -  —  -A  and  y  = 


we  reduce  9o  (  v-^ ,  v2  )  to  the  form 


Ol 


ei(“i.  »il  — £7i^7,e  . 


0»  00 

H 


Xe 


<*»  -  irxy+y')  I-  <*,*,*+ 


(10) 


dxdy. 


The  integral  in  (10)  is  a  special  case  of  (1)  when 

flu5650* 2=r~7i»  °U = •“ Y~i 
flu=*'3i°i.  Ojj  =  /sjtfj,  flM  =  0. 


From  (6)  and  (3)  we  find 


J*= 


*  (1— r1)*  (1— r»)*  1  —  r*’ 


F-TS-9311/V 


455 


■  ..Jail. ,  Vw..  ,Jf.„ _ _ v..,^  V.  n  i'ti  i  , r. 


hfjc  itjxfii'  A*.  affiga V  •.«  i 


1  •  f  . 

T^Ti  ~  TTr  I  /ol°l 

/.=  l  __  lr'i'Wt  +  e*w*  -f  o*w* 

~  1  —  r‘  “l  —  *a°a  1  —  r«  * 

/«i»  ioj>t  0 

Then 

e,  (o,.  o,) =~^=  e<t«»t'i+v»)2ic  ^nr7»  x 

* 

which  does  not  differ  in  substance  from  (3* 95 ) • 

Bty  means  of  formula  (?)  there  is  also  computed  the  integral  (3.23).  which  is  a 
special  case  of  the  integral  (1 )  when 


From  (?)  and  (8)  we  find 


«ll  —  1 

— .  9/fJ.  ft  -  ^  A  • 

<ii  — 

"  a  .v-/®  2,0>' 

•*(1- 

s  find 

• 

JO 

5» 

II 

8° 

II 

4 

a 

1 

W°i  +  v,)  .  .  _ 

•*(>  —  Aq)  ^ 

1,  we  find 

*  .  *I+1» -**.*!*. 

J.***". 

— 0*  —  to 

»  2<(Pl  +  0«) 

V  •Kt-/?2)  ~4 


I  —  2/«*(0|  -f  0|)  —  <«<(!  — 


Appendix  VI 

The  Hypergeonetri  c  Function 

The  general  expression  of  the  hypergeometric  function  is  provided  by  the  folio 
ing  series  _  , 

•••  ®f>  Ti*  •••  1,’>  x)~~ 

r(T»)r(Ti)  ..r<T,)  yt  r(«t+«)r(«t-f  «>  ^ 

r  («i)  r  («j) r  («4)  Zj  r  (ti  -l- n)  r  -t- «) ...  r  (7,  +  «)'«!'  (■) ) 
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'//lien  r  =  s  =  1,  there  is  obtained  the  conventional  hyperjeometric  series 

.n(«,  p.  r.  »)=i+fo+;SLfc|iijjiB*+ 

i  ««+>)(«+ 8)  m+w>-m  «• ,  W 

n  T  (!  +  »)(!+ 2)  31 +  - 

When  0^  =  =  y*  =  1,  series  (2)  is  transformed  into  a  geometric  progression  with 

the  denominator  x. 

Another  important  special  case  of  function  (1),  extensively  employed  in  this 
book,  is  the  degenerate  (or  confluent)  hypergeometric  function  (r  =  1,  s  =  1) 

•'■(*•  »•  +-.  o> 

The  value  of  this  function  when  x  >  2  is  linked  with  its  value  for  -x  by  the  re¬ 


lationship 


t,  x)  =  txlFl(i~a,  T,  —x). 


For  large  negative  values  of  the  argument  x,  there  takes  place  the  asymptotic 


expansion  jr 

in(«*  T»  *)  r  (,-•)'  x.[*+  x  +  (5) 

T - - +  -  J* 

If  o(,  =-n  (n  is  a  positive  integer),  then  j  Fj  (-n,y,  x)  is  transformed  into  a 
polynomial  of  the  n-th  power  with  respect  to  x.  When  Q(=  n,  V=  m(n  and  m  are  in¬ 
tegers),  jFj  (n,m,x)  is  expressed  in  terms  of  polynomials  and  exponential  functions 
of  the  argument  x.  If  =  ”  and  Y"  =  a  ,  then  |Fj  (n/2,  m,  x)  is  expressed  by  mean 
of  exponential  and  Bessel  functions  of  the  argument  x.’  Thus,  for  instance, 


i^i  (2***“^— e  2 

«f>  (“  f  •  *•  ~  x)  =e~’T[(l  +*)h  (f)+  */|  (fj], 
iF' 1  (f »  2*  —*)— e  1  [/o  (f)+  h  [£)]• 


There  is  expressed  in  terms  of  a  degenerate  hypergeometric  function  the  following 
frequently  encountered  integral  of  the  product  of  a  potential,  s  Bessel  and  an 


?-TS-°Sl  l/’/ 


exponential  function 


i+i,  (?) 

By  a  substitution  of  fl(  for  i0(  wi t’n  account  taken  of  (4),  from  (?)  there  is  also 
obtained  the  expression  of  the  integral  containin_  -;,e  Bessel  function  of  the  i- 
maginary  argument 

jf-'  /J*t)e~y“dl  = 

,+  1 

2>*‘i>  +  »>  1  'V  2  +  *  +  ’  w 

In  terms  of  degenerated  hyper geometric  functions  it  is  also  possible  to  express 

£»  \ 

the  derivatives  of  the  function  ¥(*)==p=e  * 


?<",(x)=2 


/./!+«  1 

x*v 

\  2  *  2  * 

-2) 

/I  ~n\ 

F(— 

F  (1±*  1  £?\ 

VVrT) 

r(  2/ 


Appendix  VII 


Kerir.ite  Polynomials 


The  Hernite  polynomials  Hn(x)  are  defined  by  the  relationship 

».W=(-IA  T£-.(='T).  «=0,  I,  2,  ... 

By  reiterated  partial  integration  it  is  not  difficult  to  show  that 


rTrf- «*=«, 


J"  -  10,  a, 

— 00  *4 

wherefrom  it  can  be  seen  that  Hermite  polynomials  represent  an  aggregate  of  ortho ronal:,| 
polynomials.  ,j 

From  the  definition  (1),  it  follows  that  Hn(x)  is  a  polynomial  of  the  n-th  power;, 1 
this  polynomial  containing  only  even  powers  of  x  when  n  is  even  and  only  odd  powers 

*;i 

of  x  when  n  is  odd.  >«J 

-•1 
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' 

Jl 


V  .  'IuSmSS 


<  ) 


.  O 


SiWIBB 


TT*7^  *‘r?f77-*V?Tr?  f^v1  > » ' 


Any  three  consecutive  Re  rail te  polynomials  are  linked  by  the  recurrent  relation¬ 


ship 


*•  H  M  =  x//»  to  -  nfin- 1 W- 


(3) 


The  first  five  Kermite  Polynomials  have  the  form 


//a(x)=x*-3x.  W4(x)  =  x«-6x4  +  3. 


Tne  expressions  for  Kermite  polynomials  of  a  higher  order  are  obtained  by  means  of 

(3). 

.-7  +tx  ■ 

Expanding  the  function  :  /  (/is se  into  a  Taylor  series,  we  obtain 

e-%+*  (4) 

/So 

From  (4)  when  x  =  0,  employing  the  well-known  expansion  into  a  series  of  the 
function  <e  *  and  comparing  the  coefficients  for  equal  powers  of  t  in  the  left-hand 
and  right-hand  parts,  we  find 

^3h (0)= (—  l)"(2n  —  l)!!,  //„_,( 0)S=0.  (g) 

Appendix  VIII 

Inverse  Fourier  Transformation  of  0g  (  y^,  yg,  )»  _ _ -1— 

Let  us  find  the  inverse  Fourier  transformation  of  the  two-dimensional  charac¬ 
teristic  function  (3.24),  i.e.,  let  us  calculate  the  double  integral 

W,(P,  0,  t)=-L  f  f  *-l(*'v'+''v>)dvldvi 

WiIPi.Pj,  )  4%t  J  J 


■  2 /«*  (fi+  v») — (l  —  ^ 

Let  us  represent. the  integrand  function  in  the  form  of  a  product  of  two  factors,  one 
of  which  depends  only  on  one  integration  variable. 


1  -  2ltt  (0,+ 0,)  -  40*0,0,  (I-  /?») 


(2) 


]  l-2/.*0,(l-«§j  2/901 


Employing  (2),  we  first  integrate  with  respect  to  the  variable  v^,  considering  the 
other  variable  v^  to  be  fixed,  i.e.,  we  calculate  the  integral 
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■M 


■m 


fan  juii BA 
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K(»\-  1  ?  '-"'"dot 

I  I  —  2ia>t>,  * 

J  2  °  01 


!£/■  a  substitution  of  the  integration  variable 


. rdb^hjj  2i9t°*-29iz 


the  integral  (3)  is  reduced  to  the  fom 


In  the  theory  of  gamma-functions  it  is  proved*  that 

.  «t/0» 


“  J.  *  \o,  .,<o. 


Substituting  (6)  into  (5).  we  find 


h_  l  —  ili^t 

*«-£•  p.>o. 

p,<0. 


Employing  (7),  we  find 


«• 

Wj(p,,  pj,t)  =  -^  J  K^)dVl== 


_  t  «  r  .  '  -^fc-dsgSgi. 

h-2l.»ya(l-^0)  e  1  ^ 

After  simple  transformations  and  after  a  substitution  of  the  integration  variable 

integral  (3)  is  reduced  to  the  form 

- .  y-*.-.  «+*»  AJS&.  /,+ 1\ 

l  f  **•(»-  *S)' 

W|(hihit)-  (  j.-w  J  «  -j-,  (io) 


The  integral  in  the  right-hand  part  of  (10)  coincides  with  the  well-known 


integral  representation  of  a  zero-order  Bessel  function  of  an  imaji nary  argument 
(Cf.  G.  N.  Watson,  Teoriya  besselevykh  funktsiy  (Theory  of  Bessel  Functions).  For. 
Lit.  Pub.  Hse,  1949,  p.  200). 

Thus  the  desired  two-dimensional  distribution  function  is  equal  to 

>i  -f 

W,(p,  P,  tl- _ 1 _  f#o^  1 

*'p,,pj’ }  4»< (1 — i?g) e  °Rr-^)  r 

Pi  >0.  P*>0, 

W,(p„  P2.  t)  =  0,  p,<0,  p,<0. 


which  does  not  differ  from  (3.19). 


Appendix  IX 


Nicholson’s  Function 


Let  us  investigate  the  integral 


K  (0)  =  f  cos  <fF  (s  c.os  9)  e 


«♦  tin*  f 


which  figures  in  the  right-hand  part  of  (8.57).  Substituting  into  (1)  the  expression 
for  the  Laplace  function  ?(x),  we  obtain 

•  **o*f  yi 

K(,>)  —  y~^cos'?'e  3  f  c~  3  dyd?. 

'  A  * 


Effecting  now  the  substitution  of  integration  variables 


=  sin  <f  ,  y  =  sy.  , 


we  find 


.i*r* 

K(f))  =  -J  j  e  dydx.  (2) 

•  0  — -00 

^  w 

Let  us  now  separately  examine  the  two  cases  of  0^  -g  and  6  . 

1)  0  <  shall  in  this  case  designate  integral  (1)  by  K.(0).  The 

2  1 
area  of  integration  for  ( 0 )  is  shown  in  Figure  94. 

Let  us  breakdown  the  interval  of  integration  along  y  in  (2)  into  two  sectors 


F-TC-^Sll/V 


Fig.  94.  Areas  of  integration  in  the  integral  K,  (  6). 


The  second  integral  is  broker,  down  into  two : 


V  and  rn  (cf.  Fig.  9V,. 


Integral  ??' 


is  easily  calculated  by  a  transformation  to  polar  coordinates 

K,==^*iiPe  *  d?d<t=—(l ~e  T). 

9  0 

Integral  Kn  along  the  triangular  area  may  be  written  down  in  the  form 


k"=4  \  \  *  dydx== 


The  integral 


dyldxl. 


V(*.  »)=-s 


*  dydx 


(5) 


(6) 


(7) 
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has  been  studied  by  Nicholson  (cf.  Bionetrica,  V.  ^3,  1^43 ).  The  cited  work  also 
presents  tables  of  this  integral  for  a  change  in  the  parameters  h  and  q  from  o  to  3 
at  intervals  of  0.1.  Comparing  (6)  and  (?),  we  find 

« 

K"=2V(ssin9i  s  cos#).  ^8) 

Substituting  (4),  (5)  and  (3)  into  (2),  we  obtain 

K,m=F(s,tnt)-±+±(  ,_r*)+  (9) 

+  2y(ssin0,  jcosO). 

From  (7)  it  can  be  seen  that  V(0,c}  =  7(h,0)  =  0.  Therefore  K(0)»0  arid 

2)  6  >  y  •  shall  in  this  case  designate  integral  (1)  by  KgC®).  let  ue 
break  down  the  interval  of  integration  along  ®  into  two: 


2  rf?  + 


K,  (6) = J  cos  ?F  (s  cos  <?)  e  2  di 

0 

•  »*  »>n» 9 

-\--y=  j  cos?F(scos<?)e  2  d? 


The  first  integral  coincides  with  In  the  second  integral  v;e  effect  the  sub¬ 

stitution  *p=  If  -  if  . 


n 

2%  #• 

^i»l  (®)  yT—  J  cos  <p  F  (s  cos  9)  ( 


d<?  = 


2*  r  --*1"**. 

COS  5  C0S’|»)C  2  d'f. 


and  since  ?(-s  cos  vj/ )  =  1  -  F(s  cos  ip  ),  then 


i1  tin*  j> 


K„(«)  =  — ^  j  cos^[l  — F(scos'^)le  2  — 
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-j-  f  cos  *i  F  [s  cos  <ji)  e  2  </•}»  = 

=  2{F(s  sin«)  -  F(*j]+ Kt  (-£-)  - 


«»  »ln»  {> 


—  J  cos  tyF  (s  cos  •{»)  e  2  </•{», 


or,  takinj  into  account  (t),  we  find 

K„  («) == 2  (F (s  sin  6)  —  F (5)1 + Ki  (*jr)  —  («  ~  9)> 

Substituting  (11)  into  (*:)  and  taking  into  account  (~),  we  obtain 

K2  («) = 2  K,  (-f-)  +  2F  («  sin  0)  -  2F  (s)  -  F  (s  sin  6)  -|- 
_«* 

2 j^SKfssin#,  —  scosO), 
or 

/Ca(0)=f(ssin«)-4-  + 

.  _«• 

+  -t(l-e  2J  — 2V(ssin0,  —  5Cos8). 


L-ist  of  the  Most  Generally  Used  Notations 

(Numbers  indicate  the  pa^-es  on  which  the  designations 
were  introduced) 

A  —  random  event,  2. 

A  -  random  event,  converse  to  A,  4  .. 

A(t)  -  random  function,  237. 

AQ  -  amplitude  of  carrier  oscillation,  413. 
a  -  parameter  of  normal  distribution,  46 
B  -  random  event,  6  . 

B(tr)  -  correlation  function,  1 68. 

B0(t)  -  correlation  function  of  envelope,  307. 

B^C'C)  -  correlation  function  corresponding  to  the  discrete  part  of  the  power 
spectrum,  289. 

2  fl'C}  -  correlation  function  correspondinj  to  the  continuous  part  of  the  power 
spectrum,  39&. 

3*(<C)  -  correlation  function,  averaued  over  tine,  of  a  nonstationary  random 
process,  257. 

C  -  carryin£  capacity  of  a  channel,  436, 

C(t)  -  random  function,  237. 

C(«))  -  frequency  characteristic  of  a  linear  system,  216. 
k 

Cn  -  binomial  coefficient,  16. 

D  -  determined,  5?»  transformation  jacoblan,  89. 

Dj^  -  algebraic  supplement  (Al^ebraicheskoye  dopolneniye),  57. 

S  -  envelope  of  a  set  of  curves,  236. 

E  -  elliptical  integral  of  the  2-d  kind,  264# 

e  -  base  of  natural  logarithms  (sometimes  the  symbol  exp  is  used). 

?  -  Laplace  function,  30*  one-ilnet.sional  integral  distribution  function,  4o 
highest  frequency  in  a  spectrum,  439. 
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V  -  n-dimensional  integral  distribution  function  >  55» 

-  one-dimensional  integral  distribution  function  of  tne  random  variable 

$*/5. 

-  degenerate  hypergeometric  function,  45 ?• 

FQ  -  intensity  of  white  noise,  20^. 

F(<0»)  -  power  spectrum,  1S8. 

f (x)  -  characteristic  of  a  nonlinear  system,  216, 

G  -  region  of  space,  55* 
r(W)  -  pulse  spectrum,  382. 

H  -  entropy,  80. 

H»  -  rate  of  production  of  information,  429. 

-  Hermite  polynomial  of  the  n-th  order,  458. 

H(t)  -  Fourier  transformation  of  the  square  of  a  frequency  characteristic,  220, 
H 'CO)  -  spectrum  component  of  s  pulse  process,  380. 
h(t)  -  pulse  transition  function, 219. 

h  ,  -  coefficients  of  the  expansion  into  a  series  of  a  correlation  function, 
n.< 

283. 

I  -  n-th  order  Bessel  function  of  an  imaginary  argument,  <?**. 
n 

I  -  quantity  of  information,  4^3. 

I*  -  rate  of  transmission  of  information,  ^35» 

K  -  kernel  of  an  integral  transformation,  355.' 

K  -  full  elliptical  integral  of  the  first  kind,  264. 

K(»)  -  spectrum  component  of  a  pulse  process,  379. 

k  -  [italicized)  -  event  occurrence  number  with  independent  tests,  15. 
k  -  coefficient  of  asymmetry,  69. 
k(i<*»)  -  transmission  function  of  a  linear  system,  217. 

-  Laguerre  polynomial,  306.' 

K  -  mean  number  of  symbols  emitted  in  a  unit  of  tine,  429. 

Kfc  -  central  moment  of  the  k-th  order,  64. 

n  me  •  f’J 
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-  initial  moment  of  the  k-th  order,  63. 

Kg  -  dispersion,  65* 

-  mean  value,  64, 

ra  -  index  of  modulation,  422. 

P,p  -  probabilities,  3. 

Pp  -  power  of  signal,  I83. 

P  -  power  of  noise,  I83. 

Qj^  -  orthogonal  polynomials,  i.41. 

q  -  probability,  15. 

R-  correlation  coefficient,  73,  181. 

Ry  -  coefficient  of  excess,  431. 

Sn  -  Student  distribution,  l*1'. 

S(t)  -  determined  part  of  a  random  process,  165. 

s  -  ratio  of  signal  amplitude  to  the  mean-square  value  of  noise,  721. 

T  -  time  of  observation,  period  of  repetition,  [no  page  reference  given]. 

Tn  -  Chebyshev  polynomial  of  the  n-th  order,  334 

t  -  current  time,  (Standardized  measurement  error,  153).  [sic.]] 

u  -  ootential  difference,  2 
0 

u(t)  -  envelope  of  determined  signal,  2?0. 

V  -  Nicholson  function,  461. 

W,-W,  W-  distribution  functions  (probabilities  densities) ,  42. 
wn  -  n-dimensional  distribution  function,  56. 

wlk  "  one -dimensional  distribution  function  of  the  random  variable  5*.  5*. 
x,  y,  a  -  arguments  of  distribution  functions,  45, 

^KT  ~  spectrum  of  piece  of  realization,  I85. 

0^  -  parameter  of  the  generalized  Rayleigh  function  10(\  reliability  1 52  » 
circuit  damping,  229. 

non-dimen‘.ional  magnitudes  of  determined  signals,  254,  305. 
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ft  -  magnitude,  proportional  to  the  transmits* on  band,  228. 

J"*  -  gamma-function,  31 • 

Y  -  coefficient  of , excess,  70. 

$  -  delta- function,  4J1. 

Af  -  width  of  transmission  band,  224. 

£  -  accuracy,  151* 

©  -  characteristic  function,  107. 

en-  nondimensional  characteristic  function,  111, 

\  -  Poisson-distributlon  parameter,  29. 

jji.-  power  ratio  of  continuous  and  discrete  spectra,  332 coefficient  of  com¬ 
pression,  432. 

V  -  relative  occurrence  frequency  of  an  evert,  2  ,  degree  of  nonlinearity,  234 
O'  -  parameter  of  normal  lav;  of  distribution,  46. 


4 


n. 


tO- 


0 


1 

t; 


rrl  - 


£(t),%t) 

fit) 

(2) 

(2k~l)ll 


(2!<)*.'. 


0(x)  - 


Kramo  function,  26. 

phase  [no  page  reference  given} 

modulation  frequency,  273. 

present  frequency  [no  page  reference  given} 

central  frequency  of  spectrum,  202  ,  frequency  of  carrier  oscillation,  413 

R"(0),  210. 

temporal  shift  [ no  page  reference  given} 

correlation  time,  131  ,  pulse  duration,  394. 

random  variables,  45, 

random  functions,  159. 

realization  of  a  random  function,  160. 

binomial  coefficient,  16. 

product  of  all  odd  numbers  of  a  natural  series  to  2k  -  1 ,  inclusive,  114 
product  of  all  odd  numbers  of  a  natural  series  to  2k,  inclusive,  115. 
order  of  magnitude  of  x,  23. 
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SUBJECT  INDEX 


A 

A  posteriori  probability  (cf.  conditional  probability),  6 
A  priori  probability,  6 
Addition,  rule  of,  4,  6 

Approximation  of  nonlinear  characteristics  by  exponential  series,  265 
Arithmetical  mean  of  random  variables,  149 
Asymptotic  formulas  for  hypergeomotric  function,  456 

of  Laplace,  23-27 
of  Poisson,  29-32 
of  Stirling,  21 
Autocorrelation  function,  172 

Average  number  of  intersections  of  a  given  level,  211 

B 

Bayes  formula,  9,  317 
Bessel  function,  94,  302 

,  many-variable,  282 
Binomial  law,  the,  16,  17 
Boltzmann's  constant,  223 

C 

Carrying  capacity,  436 
Central  limit  theorem,  129 

,  two-dimensional,  138 

Channel,  427 

,  without  interference,  4?7 
.with  *  42? 

Characteristic  functions  of  a  normal  random  process,  280  _ 

a  normal  sum  of  independent  random  variables,  114,  117 
a  random-phase  sinusoid,  116,  123 
a  random  process,  162 

a  random  process  at  the  output  of  a  filter,  362—367 
a  sun  of  independent  random  variables,  109,  HO 
a  uniformly-distributed  sum  of  independent  random 
variables,  116,  121 

an  aggregate  of  random  variables,  110,  112 
random  variables,  multi  dimensional,  112 
,  two-dimensional.  111 
the  square  of  a  normal  random  process,  367 
the  square  of  the  envelope  of  a  normal  random  \ 
process,  311 

Characteristic  of  a  nonlinear  system,  216 
Chebyshev  inequality,  150 
Chebyshev  polynomials,  334 
Coding,  432 

Coefficient  of  asymmetry,  69,  109,  134,  370 

of  a  process  at  the  output  of  a  standard  link,  ^75 
of  a  Rayleigh  distribution  law,  69 
Coefficient  of  compression,  432 
Coefficient  of  excess,  70,  109,  134,  370 
Coherence,  182 


V) 


Conditional  probability,  6,  ?2 

Condition  of  the  physical  feasibility  of  a  linear  system,  21? 

Continuity  of  stationary  random  process,  196 
Convolute  of  distribution  functions,  9^ 

Convolution,  theorem  of,  220,  27? 

Correlation  coefficient,  73 
Correlation  function, 

,  definition,  170 
,  multidimensional,  248 
,  properties  of,  176-181 

of  a  carrier  modulated  in  amplitude  by  a  normal  process,  420 
of  a  carrier  modulated  in  frequency  by  a  normal  process,  420 
of  a  normal  process  after  limiting,  286 

of  a  normal  process  at  the  output  of  a  linear  detector,  263 
of  a  normal  process  at  the  output  of  a  linear  network,  220 
of  a  normal  process  at  the  output  of  a  nonlinear  network,  240 
of  a  normal  process  at  the  output  of  a  square-law  detector,  269, 

273 

of  a  periodic  process,  176 
of  a  phase  cosine,  338 

of  a  pulse  random  process  with  a  random  time  of  emergence,  395 

of  a  pulse  random  process  with  random  amplitude,  ?86 

of  a  pulse  random  process  with  random  duration,  402-3 

of  the  derivative  of  a  random  process,  200 

of  the  envelope  of  a  normal  process,  306,  308 

of  the  phase  derivative  of  a  normal  random  process,  3^8-349 

of  the  phase  of  a  normal  process,  332 

of  the  square  of  the  envelope  of  a  normal  random  process,  312,  31^ 
Correlation  time,  181 

of  white  noise  which  has  passed  through  a  linear  network,  225 

Correlator,  175 
Covariance,  73 

Cumulants  of  a  random  process  at  the  output  of  a  filter,  372 
Cutoff  voltage,  279 


Delta-function,  48,  200,  275,  290-291,  3^6,  391,  451,  453 
,  derivatives  of,  453 
,  filtering  property  of,  452 
Derivative  of  a  normal  random  process,  209 

stationary  random  process,  196 
Detection  of  a  periodic  signal  in  noise,  181,  134 
Determined  part  of  a  random  process,  165 
Deviation  of  a  random  variable,  64 
Direct  component,  173*  240,  269,  275,  286 
Dispersion,  conditional,  77 
Dispersion  of  a  random  process,  167 
random  summation,  106 
random  variable,  65,  67,  68 

distributed  according  to  the  binomial  law,  6? 

Distribution,  exponential 

,  generalized  Rayleigh,  99,  103,  302 
,  normal,  46,  57 
,  Poisson,  30 
,  Rayleigh,  61,  62 
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Distribution, 

,  Simpson,  122 
,  Student,  154 
,  120 

Distribution  cuimilants,  109 
Distribution  curve,  43 

Distribution  function,  conditional,  of  random  variables,  76-79 

,  generalized  Rayleigh,  99,  103,  302 
,  multidimensional,  56 
,  normal,  46,  57 
,  random  variables,  40-45 
,  two-dimensional  51,  161 
of  a  phase  cosine,  334,  336 
of  a  random  phase  sinusoid,  91,  92 
of  a  random  process,  160 

of  a  random  process,  multi-dimensional,  162 
of  a  random  process  at  the  output  of  a  standard  link,  247-251, 
367 

of  a  sum  of  random  variables,  93 

of  the  derivative  of  the  envelope  of  a  normal  random  process, 
34° 

of  the  envelope  of  a  normal  random  process,  302-306,  309-311 
of  the  phase  derivative  of  a  normal  random  process,  340 
of  the  square  of  a  normal  .random  process,  356-359 

Distribution  mode,  44 
Distribution  moments,  central,  64 

,  initial,  64 
Distribution  surface,  53 
Duhamel's  integral,  217,  354 

E 

Edgeworth  series,  369 

Elliptical  integral  of  the  first  kind,  264 

of  the  second  kind,  264 

Entropy,  80r85,  430 

,  conditional,  84 
,  of  normal  distribution,  82 
Envelope  method,  the,  243,  244 
Envelope  of  a  random  process,  23 5 1  301 
Ergodicity,  170-174 
Error  function,  26 
Errors  in  phase  measurement,  326 
Events,  certain,  3 

,  contradictory,  3 
,  equiprobable ,  4 
,  impossible,  3 
,  incompatible,  3 
,  independent,  4 
,  practically  certain,  27 
Excess,  431 

Expansion  of  an  integral  form  with  a  symmetrical  kernel  into  a  series,  361 
Expansion  of  two-dimensional  probability .density  into  a  series,  240,  256,  312,  336 
Exponential  distribution,  310 
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Fluctuation  noise,  210 
Formula  of  total  probability,^ 

Fourier  transformation,  188 

Frequency  characteristic  of  a  linear  system,  216 
Functional  transformations  of  random  variables,  86-89 

G 

Gamma-function,  31 

Gauss's  law  of  probability  distribution,  46 
Generating  function  of  a  discrete  random  variable,  126 
Gilbert  transformation,  236 

H 

Hermite  polynomials,  135*  458 

Hypergoemetric  function,  102,  290,  330,  417,  456 

I 

Ideal  limiting,  285 
Ideal  observer,  319 
Integral  distribution  function,  40 

normal  distribution  function,  48,  49 
of  a  random  process,  222 
Rayleigh  distribution  function,  6l 
Integral  theorem  of  Laplace,  25 

Interference-resistant  properties  of  pulse  communication  systems,  409 
Interval  of  confidence,  153 
Iterated  kernel,  368 

J 

Joint  probability  distribution,  51~55 

K 

Kernel,  iterated,  368 

Kernel  of  an  integral  transformation,  355*  360-362 
Khinchin's  theorem,  188 
Kramp  function,  26,  115 

L 

Laguerre  function,  325 

Laguerre  polynomials,  306 

Laplace  function,  325 

Law  of  large  numbers,  145,  151 

Law  of  probability  distribution,  38 

,  binomial,  40 
,  multidimensional,  55 
,  normal,  45-51*  57-60 
,  one-dimensional,  40 
,•  uniform,  40 
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Limit  theorem,  central  one-dimensional,  129 

two-dimensional,  138 
Linear  detector,  261-265 
Iyapunov  theorem,  129,  250 

evaluation  of  rate  of  convergence  of,  134 


M 


». 

1  ) 


Mathematical  expectation,  64 
Markvo  chains,  36 
Mean-square  error,  232 

Hean  value  of  a  complex  random  variable,  75 

conditional  random  variable,  77 
random  process,  167 

,  for  the  aggregate.  '.67 
,  over  tine,  173 
random  variable,  64,66,  67 
random  variable  distributed  according  to  the 
binomial  law,  66 
sum  of  random  variables,  105 
Message,  continuous,  h27 
,  discrete,  427 
Message  source,  427 

,  continuous,  427 
,  discrete,  427 

Method  of  contour  integrals,  242,  243,  279 
Modulation  in  duration  of  square  pulses,  bilateral,  406 

,  unilateral,  400 


Modulator,  amplitude,  413 
,  frequency,  4l4 
,  phase,  4l4 

Most  probable  number  of  an  event,  19,  20 

Multiplication,  rule  of,  6,  8 

Mutual  correlation  function,  182,  237 

of  a  random  process  and  of  its  derivative,  198 


N 


Narrow-band  spectrum,  203 
Nicholson  function,  463 
Niemann-Pearson  criterion,  319 
Normal  random  process,  205,  208,  254,  301 

,  derivative  of,  208 

Normalization  of  a  random  process  by  a  narrow-band  linear  system,  250 
Normalized  deviation  of  a  random  variable,  65 
Number  of  occurences  of  an  event,  15,  39 

Numerical  characteristics  of  an  aggregate  of  random  variables,  72,  73 

functions  of  random  variables,  104,  107 
random  variables,  63,  66 

0 


Occurrence  frequency  of  an  event,  2,  3 
Optimum  linear  systems,  231-235 
Orthogonal  functions,  proper,  362 
Orthogonal  polynomials,  241 
Overmodulation,  413 
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p 

Passage  of  white  noise  through  a  system  with  a  gausnian  frequency  characteristic,  228 

an  ideal  linear  system,  226 
an  oscillatory  circuit,  229 
Phase  of  a  random  process,  235 ,  320,  326 
Poisson  distribution,  30-31 
Poisson  function,  30-31 

Possible  values  of  a  discrete  random  function,  38 
Power  spectrum,  determination  of,  186-191 
,  narrow-band,  203 
,  wi de-band,  204 

Power  spectrum  at  the  output  of  a  linear  system,  219 

at  the  output  of  a  nonlinear  system,  239 

of  a  carrier  modulated  in  amplitude  by  a  normal  process,  417 
of  a  carrier  modulated  in  frequency,  420 
of  a  generalized  telegraphic  signal,  191-195 
of  a  normal  process  after  limiting,  285 

of  a  normal  process  at  the  output,  of  a  linear  detector,  261 
of  a  normal -process  at  the  output  of  a  square-law  detector,  2?0 
of  a  pulBe  random  process  with  random  amplitude,  383 

with  random  duration,  397 
with  random  time  of  emergence,  388-389 
of  the  derivative  of  a  random  process,  349 
of  the  integral  of  a  random  process,  222 
of  quantization  noise,  293-299 
of  the  envelope  of  a  normal  process,  306 
Power  width  of  pass  band,  225 
Probability  density,  43 
Probability  of  a  posteriori.  6 
a  priori,  6 
an  event,  2 
Proper  values,  362 
Pulsation  of  a  random  process,  179 
Pulse-code  modulation,  293 
Pulse  random  process,  376 
Pulse  transfer  function,  217 

Q 

Quantity  of  information,  433 
Quantization,  163 
Quantization  noise,  293 

S 

Radio  equipment,  elements  of  linear  (inertial).,  216 

non-linear  (non-inertial) ,  216 

Random  experiment,  2 
Random  process 

,  continuity  of,  196 
,  differentiability  of,  196 
,  ergodlcity  of,  170 
,  narrow-band,  202,  257 
,  normal,  205,  208,  254,  301 
,  stationnrity  of,  166 
,  wide-band,  20,3 
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Random  process 

,  with  a> discrete  spectrum*  198 
,  with  discrete  tine,  376 
,  without  consequence ,  170- 
Random  variables,  continuous,  38 
,  line  or  related,  73 
*  discrete,  38 
•Random  walk''  problem,  142 
Realisation  of  a  random  process,  160 
Reliability  of  radio  equipment,  9,  11 


S 


Second-order  moment,  mixed,  73 

Semi invar iant,  109 

Sequence  of  base  impulses,  163 

Sequence  of  independent  tests,  15,  17 

Set  of  events,  9 

Shannon's  Theorem,  437 

Shot  effect,  32,  33 

Signal,  telegraph,  12,  34 

Signal/ noise  ratio,  282,  443 

Standard  link  of  radio  equipment,  218 

S.tationarity ,  166 

in  the  broad  and  narrow  senses,  169 
Statistical  criteria  of  detection,  31^ 

Successive  observer,  319 


Theorem  of  Khinchin,  188 

Kotel'nikov,  -186,  439 
Lyapunov,  129 
Shannon,  437 

Transformation  Jacobian,  89 
Transient  process  in  a  linear  system,  221 
Transition  to  polar  coordinates,  97*  99,  246 
Transmi 88 ion-band  width,  power  definition,  224 

,  of  a  linear  system  with  a  gaussian 
frequency  characteristic,  229 

/  ,  of  an  oscillatory  circuit,  230 

Transmission  function  of  a  linear  system,  217 

.  U 


--Unreliability ,  152 

V 


Weighting  function,  24l 
Vi de-band  spectrum,  204 
\  "White  noise",  204,  223 


